Nov 15 23:11:08 user nova-compute[76391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=76391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=76391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=76391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 23:11:08 user nova-compute[76391]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:11:08 user nova-compute[76391]: INFO nova.virt.driver [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 23:11:08 user nova-compute[76391]: INFO nova.compute.provider_config [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Acquiring lock "singleton_lock" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Acquired lock "singleton_lock" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Releasing lock "singleton_lock" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Full set of CONF: {{(pid=76391) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ******************************************************************************** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Configuration options gathered from: {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ================================================================================ {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] allow_resize_to_same_host      = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] arq_binding_timeout            = 300 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] backdoor_port                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] backdoor_socket                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] block_device_allocate_retries  = 300 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] block_device_allocate_retries_interval = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cert                           = self.pem {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute_monitors               = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] config_dir                     = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] config_drive_format            = iso9660 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] config_source                  = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] console_host                   = user {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] control_exchange               = nova {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cpu_allocation_ratio           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] daemon                         = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] debug                          = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] default_access_ip_network_name = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] default_availability_zone      = nova {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] default_ephemeral_format       = ext4 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] default_green_pool_size        = 1000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] default_schedule_zone          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] disk_allocation_ratio          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] enable_new_services            = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] enabled_apis                   = ['osapi_compute'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] enabled_ssl_apis               = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] flat_injected                  = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] force_config_drive             = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] force_raw_images               = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] graceful_shutdown_timeout      = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] heal_instance_info_cache_interval = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] host                           = user {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] initial_disk_allocation_ratio  = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] initial_ram_allocation_ratio   = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instance_build_timeout         = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instance_delete_interval       = 300 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instance_format                = [instance: %(uuid)s]  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instance_name_template         = instance-%08x {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instance_usage_audit           = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instance_usage_audit_period    = month {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] internal_service_availability_zone = internal {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] key                            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] live_migration_retry_count     = 30 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_config_append              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_dir                        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_file                       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_options                    = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_rotate_interval            = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_rotate_interval_type       = days {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] log_rotation_type              = none {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] long_rpc_timeout               = 1800 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] max_concurrent_builds          = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] max_concurrent_live_migrations = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] max_concurrent_snapshots       = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] max_local_block_devices        = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] max_logfile_count              = 30 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] max_logfile_size_mb            = 200 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] maximum_instance_delete_attempts = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] metadata_listen                = 0.0.0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] metadata_listen_port           = 8775 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] metadata_workers               = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] migrate_max_retries            = -1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] mkisofs_cmd                    = genisoimage {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] my_block_storage_ip            = 10.0.0.210 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] my_ip                          = 10.0.0.210 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] network_allocate_retries       = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] osapi_compute_listen           = 0.0.0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] osapi_compute_listen_port      = 8774 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] osapi_compute_unique_server_name_scope =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] osapi_compute_workers          = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] password_length                = 12 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] periodic_enable                = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] periodic_fuzzy_delay           = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] pointer_model                  = ps2mouse {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] preallocate_images             = none {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] publish_errors                 = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] pybasedir                      = /opt/stack/nova {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ram_allocation_ratio           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rate_limit_burst               = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rate_limit_except_level        = CRITICAL {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rate_limit_interval            = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] reboot_timeout                 = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] reclaim_instance_interval      = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] record                         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] reimage_timeout_per_gb         = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] report_interval                = 120 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rescue_timeout                 = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] reserved_host_cpus             = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] reserved_host_disk_mb          = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] reserved_host_memory_mb        = 512 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] reserved_huge_pages            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] resize_confirm_window          = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] resize_fs_using_block_device   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] resume_guests_state_on_host_boot = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rpc_response_timeout           = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] run_external_periodic_tasks    = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] running_deleted_instance_action = reap {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] running_deleted_instance_poll_interval = 1800 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] running_deleted_instance_timeout = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler_instance_sync_interval = 120 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_down_time              = 720 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] servicegroup_driver            = db {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] shelved_offload_time           = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] shelved_poll_interval          = 3600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] shutdown_timeout               = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] source_is_ipv6                 = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ssl_only                       = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] state_path                     = /opt/stack/data/nova {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] sync_power_state_interval      = 600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] sync_power_state_pool_size     = 1000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] syslog_log_facility            = LOG_USER {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] tempdir                        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] timeout_nbd                    = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] transport_url                  = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] update_resources_interval      = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] use_cow_images                 = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] use_eventlog                   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] use_journal                    = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] use_json                       = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] use_rootwrap_daemon            = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] use_stderr                     = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] use_syslog                     = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vcpu_pin_set                   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plugging_is_fatal          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plugging_timeout           = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] virt_mkfs                      = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] volume_usage_poll_interval     = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] watch_log_file                 = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] web                            = /usr/share/spice-html5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_concurrency.disable_process_locking = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.auth_strategy              = keystone {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.compute_link_prefix        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.dhcp_domain                = novalocal {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.enable_instance_password   = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.glance_link_prefix         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.instance_list_cells_batch_strategy = distributed {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.instance_list_per_project_cells = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.list_records_by_skipping_down_cells = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.local_metadata_per_cell    = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.max_limit                  = 1000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.metadata_cache_expiration  = 15 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.neutron_default_tenant_id  = default {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.use_forwarded_for          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.use_neutron_default_nets   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.vendordata_dynamic_failure_fatal = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.vendordata_dynamic_targets = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.vendordata_jsonfile_path   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.backend                  = dogpile.cache.memcached {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.backend_argument         = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.config_prefix            = cache.oslo {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.dead_timeout             = 60.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.debug_cache_backend      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.enable_retry_client      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.enable_socket_keepalive  = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.enabled                  = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.expiration_time          = 600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.hashclient_retry_attempts = 2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_dead_retry      = 300 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_password        =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_pool_maxsize    = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_sasl_enabled    = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.memcache_username        =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.proxies                  = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.retry_attempts           = 2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.retry_delay              = 0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.socket_keepalive_count   = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.socket_keepalive_idle    = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.socket_keepalive_interval = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.tls_allowed_ciphers      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.tls_cafile               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.tls_certfile             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.tls_enabled              = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cache.tls_keyfile              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.auth_section            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.auth_type               = password {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.cafile                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.catalog_info            = volumev3::publicURL {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.certfile                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.collect_timing          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.cross_az_attach         = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.debug                   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.endpoint_template       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.http_retries            = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.insecure                = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.keyfile                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.os_region_name          = RegionOne {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.split_loggers           = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cinder.timeout                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.cpu_dedicated_set      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.cpu_shared_set         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.image_type_exclude_list = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.live_migration_wait_for_vif_plug = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.max_concurrent_disk_ops = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.max_disk_devices_to_attach = -1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.resource_provider_association_refresh = 300 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.shutdown_retry_interval = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] conductor.workers              = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] console.allowed_origins        = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] console.ssl_ciphers            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] console.ssl_minimum_version    = default {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] consoleauth.token_ttl          = 600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.cafile                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.certfile                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.collect_timing          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.connect_retries         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.connect_retry_delay     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.endpoint_override       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.insecure                = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.keyfile                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.max_version             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.min_version             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.region_name             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.service_name            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.service_type            = accelerator {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.split_loggers           = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.status_code_retries     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.status_code_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.timeout                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] cyborg.version                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.backend               = sqlalchemy {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.connection            = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.connection_debug      = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.connection_parameters =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.connection_recycle_time = 3600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.connection_trace      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.db_inc_retry_interval = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.db_max_retries        = 20 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.db_max_retry_interval = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.db_retry_interval     = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.max_overflow          = 50 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.max_pool_size         = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.max_retries           = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.mysql_wsrep_sync_wait = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.pool_timeout          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.retry_interval        = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.slave_connection      = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] database.sqlite_synchronous    = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.backend           = sqlalchemy {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.connection        = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.connection_debug  = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.connection_parameters =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.connection_recycle_time = 3600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.connection_trace  = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.db_inc_retry_interval = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.db_max_retries    = 20 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.db_max_retry_interval = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.db_retry_interval = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.max_overflow      = 50 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.max_pool_size     = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.max_retries       = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.mysql_wsrep_sync_wait = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.pool_timeout      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.retry_interval    = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.slave_connection  = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] api_database.sqlite_synchronous = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] devices.enabled_mdev_types     = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ephemeral_storage_encryption.enabled = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ephemeral_storage_encryption.key_size = 512 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.api_servers             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.cafile                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.certfile                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.collect_timing          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.connect_retries         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.connect_retry_delay     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.debug                   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.default_trusted_certificate_ids = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.enable_certificate_validation = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.enable_rbd_download     = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.endpoint_override       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.insecure                = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.keyfile                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.max_version             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.min_version             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.num_retries             = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.rbd_ceph_conf           =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.rbd_connect_timeout     = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.rbd_pool                =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.rbd_user                =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.region_name             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.service_name            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.service_type            = image {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.split_loggers           = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.status_code_retries     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.status_code_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.timeout                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.verify_glance_signatures = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] glance.version                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] guestfs.debug                  = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.config_drive_cdrom      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.config_drive_inject_password = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.enable_instance_metrics_collection = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.enable_remotefx         = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.instances_path_share    =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.iscsi_initiator_list    = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.limit_cpu_features      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.power_state_check_timeframe = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.power_state_event_polling_interval = 2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.use_multipath_io        = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.volume_attach_retry_count = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.volume_attach_retry_interval = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.vswitch_name            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] mks.enabled                    = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] image_cache.manager_interval   = 2400 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] image_cache.precache_concurrency = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] image_cache.remove_unused_base_images = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] image_cache.subdirectory_name  = _base {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.api_max_retries         = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.api_retry_interval      = 2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.auth_section            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.auth_type               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.cafile                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.certfile                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.collect_timing          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.conductor_group         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.connect_retries         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.connect_retry_delay     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.endpoint_override       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.insecure                = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.keyfile                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.max_version             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.min_version             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.peer_list               = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.region_name             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.serial_console_state_timeout = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.service_name            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.service_type            = baremetal {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.split_loggers           = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.status_code_retries     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.status_code_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.timeout                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ironic.version                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] key_manager.fixed_key          = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.barbican_api_version  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.barbican_endpoint     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.barbican_endpoint_type = public {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.barbican_region_name  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.cafile                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.certfile              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.collect_timing        = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.insecure              = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.keyfile               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.number_of_retries     = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.retry_delay           = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.send_service_user_token = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.split_loggers         = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.timeout               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.verify_ssl            = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican.verify_ssl_path       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.auth_section = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.auth_type = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.cafile   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.certfile = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.collect_timing = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.insecure = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.keyfile  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.split_loggers = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] barbican_service_user.timeout  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.approle_role_id          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.approle_secret_id        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.cafile                   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.certfile                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.collect_timing           = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.insecure                 = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.keyfile                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.kv_mountpoint            = secret {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.kv_path                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.kv_version               = 2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.namespace                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.root_token_id            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.split_loggers            = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.ssl_ca_crt_file          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.timeout                  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.use_ssl                  = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.auth_section          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.auth_type             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.cafile                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.certfile              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.collect_timing        = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.connect_retries       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.connect_retry_delay   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.endpoint_override     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.insecure              = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.keyfile               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.max_version           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.min_version           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.region_name           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.service_name          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.service_type          = identity {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.split_loggers         = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.status_code_retries   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.status_code_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.timeout               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] keystone.version               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.connection_uri         =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.cpu_mode               = custom {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.cpu_model_extra_flags  = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: WARNING oslo_config.cfg [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.cpu_power_governor_high = performance {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.cpu_power_governor_low = powersave {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.cpu_power_management   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.device_detach_attempts = 8 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.device_detach_timeout  = 20 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.disk_cachemodes        = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.disk_prefix            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.enabled_perf_events    = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.file_backed_memory     = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.gid_maps               = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.hw_disk_discard        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.hw_machine_type        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.images_rbd_ceph_conf   =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.images_rbd_glance_store_name =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.images_rbd_pool        = rbd {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.images_type            = default {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.images_volume_group    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.inject_key             = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.inject_partition       = -2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.inject_password        = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.iscsi_iface            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.iser_use_multipath     = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_bandwidth = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_completion_timeout = 800 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_downtime = 500 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_downtime_delay = 75 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_downtime_steps = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_inbound_addr = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_permit_auto_converge = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_permit_post_copy = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_scheme  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_timeout_action = abort {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_tunnelled = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: WARNING oslo_config.cfg [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 23:11:08 user nova-compute[76391]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 23:11:08 user nova-compute[76391]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 23:11:08 user nova-compute[76391]: and ``live_migration_inbound_addr`` respectively.
Nov 15 23:11:08 user nova-compute[76391]: ).  Its value may be silently ignored in the future.
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.live_migration_with_native_tls = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.max_queues             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.mem_stats_period_seconds = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.nfs_mount_options      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.num_aoe_discover_tries = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.num_iser_scan_tries    = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.num_memory_encrypted_guests = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.num_nvme_discover_tries = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.num_pcie_ports         = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.num_volume_scan_tries  = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.pmem_namespaces        = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.quobyte_client_cfg     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rbd_connect_timeout    = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rbd_secret_uuid        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rbd_user               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.realtime_scheduler_priority = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.remote_filesystem_transport = ssh {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rescue_image_id        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rescue_kernel_id       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rescue_ramdisk_id      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.rx_queue_size          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.smbfs_mount_options    =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.snapshot_compression   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.snapshot_image_format  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.sparse_logical_volumes = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.swtpm_enabled          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.swtpm_group            = tss {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.swtpm_user             = tss {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.sysinfo_serial         = unique {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.tb_cache_size          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.tx_queue_size          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.uid_maps               = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.use_virtio_for_bridges = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.virt_type              = kvm {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.volume_clear           = zero {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.volume_clear_size      = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.volume_use_multipath   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.vzstorage_cache_path   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.vzstorage_mount_group  = qemu {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.vzstorage_mount_opts   = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.vzstorage_mount_user   = stack {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.auth_section           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.auth_type              = password {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.cafile                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.certfile               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.collect_timing         = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.connect_retries        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.connect_retry_delay    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.default_floating_pool  = public {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.endpoint_override      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.extension_sync_interval = 600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.http_retries           = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.insecure               = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.keyfile                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.max_version            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.metadata_proxy_shared_secret = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.min_version            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.ovs_bridge             = br-int {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.physnets               = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.region_name            = RegionOne {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.service_metadata_proxy = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.service_name           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.service_type           = network {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.split_loggers          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.status_code_retries    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.status_code_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.timeout                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] neutron.version                = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] notifications.bdms_in_notifications = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] notifications.default_level    = INFO {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] notifications.notification_format = unversioned {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] notifications.notify_on_state_change = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] pci.alias                      = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] pci.device_spec                = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] pci.report_in_placement        = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.auth_section         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.auth_type            = password {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.cafile               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.certfile             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.collect_timing       = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.connect_retries      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.connect_retry_delay  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.default_domain_id    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.default_domain_name  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.domain_id            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.domain_name          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.endpoint_override    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.insecure             = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.keyfile              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.max_version          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.min_version          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.password             = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.project_domain_id    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.project_domain_name  = Default {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.project_id           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.project_name         = service {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.region_name          = RegionOne {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.service_name         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.service_type         = placement {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.split_loggers        = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.status_code_retries  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.status_code_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.system_scope         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.timeout              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.trust_id             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.user_domain_id       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.user_domain_name     = Default {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.user_id              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.username             = placement {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] placement.version              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.cores                    = 20 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.count_usage_from_placement = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.injected_file_content_bytes = 10240 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.injected_file_path_length = 255 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.injected_files           = 5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.instances                = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.key_pairs                = 100 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.metadata_items           = 128 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.ram                      = 51200 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.recheck_quota            = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.server_group_members     = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] quota.server_groups            = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rdp.enabled                    = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.image_metadata_prefilter = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.max_attempts         = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.max_placement_results = 1000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.query_placement_for_image_type_support = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] scheduler.workers              = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.host_subset_size = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.image_properties_default_architecture = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.isolated_hosts = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.isolated_images = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.max_instances_per_host = 50 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.pci_in_placement = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.track_instance_changes = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] metrics.required               = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] metrics.weight_multiplier      = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] metrics.weight_setting         = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] serial_console.enabled         = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] serial_console.port_range      = 10000:20000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] serial_console.serialproxy_port = 6083 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.auth_section      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.auth_type         = password {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.cafile            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.certfile          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.collect_timing    = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.insecure          = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.keyfile           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.send_service_user_token = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.split_loggers     = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] service_user.timeout           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.agent_enabled            = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.enabled                  = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.html5proxy_port          = 6082 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.image_compression        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.jpeg_compression         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.playback_compression     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.server_listen            = 127.0.0.1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.streaming_mode           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] spice.zlib_compression         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] upgrade_levels.baseapi         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] upgrade_levels.cert            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] upgrade_levels.compute         = auto {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] upgrade_levels.conductor       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] upgrade_levels.scheduler       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.auth_section = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.auth_type = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.cafile = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.certfile = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.collect_timing = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.insecure = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.keyfile = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.split_loggers = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vendordata_dynamic_auth.timeout = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.api_retry_count         = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.ca_file                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.cache_prefix            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.cluster_name            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.connection_pool_size    = 10 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.console_delay_seconds   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.datastore_regex         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.host_ip                 = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.host_password           = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.host_port               = 443 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.host_username           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.insecure                = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.integration_bridge      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.maximum_objects         = 100 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.pbm_default_policy      = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.pbm_enabled             = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.pbm_wsdl_location       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.serial_port_proxy_uri   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.serial_port_service_uri = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.task_poll_interval      = 0.5 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.use_linked_clone        = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.vnc_keymap              = en-us {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.vnc_port                = 5900 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vmware.vnc_port_total          = 10000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.auth_schemes               = ['none'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.enabled                    = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.novncproxy_port            = 6080 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.server_listen              = 0.0.0.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.vencrypt_ca_certs          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.vencrypt_client_cert       = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vnc.vencrypt_client_key        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.disable_fallback_pcpu_query = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.disable_group_policy_check_upcall = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.disable_rootwrap   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.enable_numa_live_migration = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.handle_virt_lifecycle_events = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.libvirt_disable_apic = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.never_download_image_if_on_rbd = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.client_socket_timeout     = 900 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.default_pool_size         = 1000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.keep_alive                = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.max_header_line           = 16384 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.secure_proxy_ssl_header   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.ssl_ca_file               = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.ssl_cert_file             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.ssl_key_file              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.tcp_keepidle              = 600 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] zvm.ca_file                    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] zvm.cloud_connector_url        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] zvm.reachable_timeout          = 300 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.enforce_new_defaults = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.enforce_scope      = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.policy_default_rule = default {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.policy_file        = policy.yaml {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.connection_string     = messaging:// {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.enabled               = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.es_doc_type           = notification {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.es_scroll_size        = 10000 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.es_scroll_time        = 2m {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.filter_error_trace    = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.hmac_keys             = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.sentinel_service_name = mymaster {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.socket_timeout        = 0.1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.trace_requests        = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler.trace_sqlalchemy      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler_jaeger.process_tags   = {} {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler_jaeger.service_name_prefix = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] profiler_otlp.service_name_prefix = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] remote_debug.host              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] remote_debug.port              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:08 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.ssl      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_notifications.retry = -1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_messaging_notifications.transport_url = **** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.auth_section        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.auth_type           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.cafile              = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.certfile            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.collect_timing      = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.connect_retries     = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.connect_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.endpoint_id         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.endpoint_override   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.insecure            = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.keyfile             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.max_version         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.min_version         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.region_name         = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.service_name        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.service_type        = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.split_loggers       = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.status_code_retries = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.status_code_retry_delay = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.timeout             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.valid_interfaces    = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_limit.version             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_reports.file_event_handler = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] oslo_reports.log_dir           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_linux_bridge_privileged.group = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_linux_bridge_privileged.user = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_ovs_privileged.group  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_ovs_privileged.helper_command = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] vif_plug_ovs_privileged.user   = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.flat_interface = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_linux_bridge.vlan_interface = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_ovs.isolate_vif         = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_ovs.ovsdb_interface     = native {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_vif_ovs.per_port_bridge     = False {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] os_brick.lock_path             = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] privsep_osbrick.capabilities   = [21] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] privsep_osbrick.group          = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] privsep_osbrick.helper_command = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] privsep_osbrick.thread_pool_size = 12 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] privsep_osbrick.user           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] nova_sys_admin.group           = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] nova_sys_admin.helper_command  = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] nova_sys_admin.thread_pool_size = 12 {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] nova_sys_admin.user            = None {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG oslo_service.service [None req-1d992799-8207-40db-8593-c8a033ce69ad None None] ******************************************************************************** {{(pid=76391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 23:11:09 user nova-compute[76391]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 23:11:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Connecting to libvirt: qemu:///system {{(pid=76391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f976487a440> {{(pid=76391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 23:11:09 user nova-compute[76391]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 23:11:09 user nova-compute[76391]: WARNING nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 23:11:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f976487a440> {{(pid=76391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Starting native event thread {{(pid=76391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Starting green dispatch thread {{(pid=76391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 23:11:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Starting connection event dispatch thread {{(pid=76391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 23:11:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Connection event '1' reason 'None'
Nov 15 23:11:09 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 23:11:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.mount [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Initialising _HostMountState generation 0 {{(pid=76391) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 23:11:16 user nova-compute[76391]: INFO nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host capabilities <capabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <host>
Nov 15 23:11:16 user nova-compute[76391]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 23:11:16 user nova-compute[76391]:     <cpu>
Nov 15 23:11:16 user nova-compute[76391]:       <arch>x86_64</arch>
Nov 15 23:11:16 user nova-compute[76391]:       <model>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <microcode version='1070'/>
Nov 15 23:11:16 user nova-compute[76391]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 23:11:16 user nova-compute[76391]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='osxsave'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='invtsc'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='rsba'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 23:11:16 user nova-compute[76391]:       <pages unit='KiB' size='4'/>
Nov 15 23:11:16 user nova-compute[76391]:       <pages unit='KiB' size='2048'/>
Nov 15 23:11:16 user nova-compute[76391]:     </cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <power_management>
Nov 15 23:11:16 user nova-compute[76391]:       <suspend_mem/>
Nov 15 23:11:16 user nova-compute[76391]:       <suspend_disk/>
Nov 15 23:11:16 user nova-compute[76391]:       <suspend_hybrid/>
Nov 15 23:11:16 user nova-compute[76391]:     </power_management>
Nov 15 23:11:16 user nova-compute[76391]:     <iommu support='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <migration_features>
Nov 15 23:11:16 user nova-compute[76391]:       <live/>
Nov 15 23:11:16 user nova-compute[76391]:       <uri_transports>
Nov 15 23:11:16 user nova-compute[76391]:         <uri_transport>tcp</uri_transport>
Nov 15 23:11:16 user nova-compute[76391]:         <uri_transport>rdma</uri_transport>
Nov 15 23:11:16 user nova-compute[76391]:       </uri_transports>
Nov 15 23:11:16 user nova-compute[76391]:     </migration_features>
Nov 15 23:11:16 user nova-compute[76391]:     <topology>
Nov 15 23:11:16 user nova-compute[76391]:       <cells num='2'>
Nov 15 23:11:16 user nova-compute[76391]:         <cell id='0'>
Nov 15 23:11:16 user nova-compute[76391]:           <memory unit='KiB'>8189224</memory>
Nov 15 23:11:16 user nova-compute[76391]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 15 23:11:16 user nova-compute[76391]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 23:11:16 user nova-compute[76391]:           <distances>
Nov 15 23:11:16 user nova-compute[76391]:             <sibling id='0' value='10'/>
Nov 15 23:11:16 user nova-compute[76391]:             <sibling id='1' value='20'/>
Nov 15 23:11:16 user nova-compute[76391]:           </distances>
Nov 15 23:11:16 user nova-compute[76391]:           <cpus num='6'>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 23:11:16 user nova-compute[76391]:           </cpus>
Nov 15 23:11:16 user nova-compute[76391]:         </cell>
Nov 15 23:11:16 user nova-compute[76391]:         <cell id='1'>
Nov 15 23:11:16 user nova-compute[76391]:           <memory unit='KiB'>8206460</memory>
Nov 15 23:11:16 user nova-compute[76391]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 15 23:11:16 user nova-compute[76391]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 23:11:16 user nova-compute[76391]:           <distances>
Nov 15 23:11:16 user nova-compute[76391]:             <sibling id='0' value='20'/>
Nov 15 23:11:16 user nova-compute[76391]:             <sibling id='1' value='10'/>
Nov 15 23:11:16 user nova-compute[76391]:           </distances>
Nov 15 23:11:16 user nova-compute[76391]:           <cpus num='6'>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 23:11:16 user nova-compute[76391]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 23:11:16 user nova-compute[76391]:           </cpus>
Nov 15 23:11:16 user nova-compute[76391]:         </cell>
Nov 15 23:11:16 user nova-compute[76391]:       </cells>
Nov 15 23:11:16 user nova-compute[76391]:     </topology>
Nov 15 23:11:16 user nova-compute[76391]:     <cache>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 23:11:16 user nova-compute[76391]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 23:11:16 user nova-compute[76391]:     </cache>
Nov 15 23:11:16 user nova-compute[76391]:     <secmodel>
Nov 15 23:11:16 user nova-compute[76391]:       <model>apparmor</model>
Nov 15 23:11:16 user nova-compute[76391]:       <doi>0</doi>
Nov 15 23:11:16 user nova-compute[76391]:     </secmodel>
Nov 15 23:11:16 user nova-compute[76391]:     <secmodel>
Nov 15 23:11:16 user nova-compute[76391]:       <model>dac</model>
Nov 15 23:11:16 user nova-compute[76391]:       <doi>0</doi>
Nov 15 23:11:16 user nova-compute[76391]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 23:11:16 user nova-compute[76391]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 23:11:16 user nova-compute[76391]:     </secmodel>
Nov 15 23:11:16 user nova-compute[76391]:   </host>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='alpha'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>clipper</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='armv6l'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>spitz</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>nuri</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>kzm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sx1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>z2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>tosa</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>n810</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>n800</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>terrier</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>midway</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>microbit</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>verdex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>highbank</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>akita</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>connex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>collie</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='armv7l'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>spitz</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>nuri</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>kzm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sx1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>z2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>tosa</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>n810</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>n800</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>terrier</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>midway</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>microbit</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>verdex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>highbank</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>akita</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>connex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>collie</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='aarch64'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>spitz</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>nuri</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>kzm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sx1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>z2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>tosa</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>n810</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>n800</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>terrier</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>midway</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>microbit</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>verdex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>highbank</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>akita</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>connex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>collie</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <acpi default='on' toggle='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='cris'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='i686'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>isapc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>microvm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='kvm'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <pae/>
Nov 15 23:11:16 user nova-compute[76391]:       <nonpae/>
Nov 15 23:11:16 user nova-compute[76391]:       <acpi default='on' toggle='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:       <apic default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='m68k'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>an5206</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>q800</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='microblaze'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='microblazeel'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='mips'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='16'>malta</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='mipsel'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='16'>malta</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='mips64'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='16'>malta</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>pica61</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>magnum</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='mips64el'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='16'>malta</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>pica61</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>magnum</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='16'>boston</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='ppc'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mac99</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>40p</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>taihu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='ppc64'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>taihu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>40p</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mac99</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='ppc64le'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>taihu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>40p</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>mac99</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='riscv32'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='8'>spike</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='8'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='riscv64'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='8'>spike</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='8'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='s390x'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='sh4'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>shix</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>r2d</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='sh4eb'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>shix</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>r2d</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='sparc'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>LX</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='sparc64'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>niagara</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='x86_64'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>64</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='1'>isapc</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>microvm</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='kvm'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <acpi default='on' toggle='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:       <apic default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='xtensa'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>sim</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>kc705</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>ml605</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx200</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx60</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]:   <guest>
Nov 15 23:11:16 user nova-compute[76391]:     <os_type>hvm</os_type>
Nov 15 23:11:16 user nova-compute[76391]:     <arch name='xtensaeb'>
Nov 15 23:11:16 user nova-compute[76391]:       <wordsize>32</wordsize>
Nov 15 23:11:16 user nova-compute[76391]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='4'>sim</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>kc705</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>ml605</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>virt</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx200</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>lx60</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 23:11:16 user nova-compute[76391]:       <domain type='qemu'/>
Nov 15 23:11:16 user nova-compute[76391]:     </arch>
Nov 15 23:11:16 user nova-compute[76391]:     <features>
Nov 15 23:11:16 user nova-compute[76391]:       <cpuselection/>
Nov 15 23:11:16 user nova-compute[76391]:       <deviceboot/>
Nov 15 23:11:16 user nova-compute[76391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     </features>
Nov 15 23:11:16 user nova-compute[76391]:   </guest>
Nov 15 23:11:16 user nova-compute[76391]: </capabilities>
Nov 15 23:11:16 user nova-compute[76391]: 
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-i440fx-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>i686</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='255'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'/>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='lm'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ide</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-i440fx-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>i686</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='255'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'/>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='lm'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ide</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-q35-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>i686</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='288'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'/>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='lm'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-q35-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>i686</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='288'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'/>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='lm'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-i440fx-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>x86_64</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='255'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>efi</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='invtsc'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='rsba'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ide</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-i440fx-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>x86_64</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='255'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>efi</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='invtsc'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='rsba'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ide</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-q35-6.2</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>x86_64</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='288'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>efi</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='invtsc'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='rsba'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 23:11:16 user nova-compute[76391]: <domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 23:11:16 user nova-compute[76391]:   <domain>kvm</domain>
Nov 15 23:11:16 user nova-compute[76391]:   <machine>pc-q35-jammy</machine>
Nov 15 23:11:16 user nova-compute[76391]:   <arch>x86_64</arch>
Nov 15 23:11:16 user nova-compute[76391]:   <vcpu max='288'/>
Nov 15 23:11:16 user nova-compute[76391]:   <iothreads supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:   <os supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='firmware'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>efi</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:     <loader supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>rom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pflash</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='readonly'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='secure'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>yes</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>no</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </loader>
Nov 15 23:11:16 user nova-compute[76391]:   </os>
Nov 15 23:11:16 user nova-compute[76391]:   <cpu>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='hostPassthroughMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='maximum' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='maximumMigratable'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>on</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>off</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='host-model' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <vendor>Intel</vendor>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ss'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='vmx'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pcid'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='hypervisor'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arat'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='umip'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='md-clear'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='invtsc'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibpb'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='ibrs'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='rsba'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='erms'/>
Nov 15 23:11:16 user nova-compute[76391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:     <mode name='custom' supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>qemu64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>qemu32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>phenom</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>pentium</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>n270</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm64</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>kvm32</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>coreduo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>core2duo</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>athlon</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Westmere</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Snowridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Skylake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>SandyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Penryn</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G5</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G4</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G3</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Opteron_G2</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>IvyBridge</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Icelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Haswell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>EPYC</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Dhyana</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cooperlake</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>Conroe</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='no'>Broadwell</model>
Nov 15 23:11:16 user nova-compute[76391]:       <model usable='yes'>486</model>
Nov 15 23:11:16 user nova-compute[76391]:     </mode>
Nov 15 23:11:16 user nova-compute[76391]:   </cpu>
Nov 15 23:11:16 user nova-compute[76391]:   <memoryBacking supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:     <enum name='sourceType'>
Nov 15 23:11:16 user nova-compute[76391]:       <value>file</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>anonymous</value>
Nov 15 23:11:16 user nova-compute[76391]:       <value>memfd</value>
Nov 15 23:11:16 user nova-compute[76391]:     </enum>
Nov 15 23:11:16 user nova-compute[76391]:   </memoryBacking>
Nov 15 23:11:16 user nova-compute[76391]:   <devices>
Nov 15 23:11:16 user nova-compute[76391]:     <disk supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='diskDevice'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>disk</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cdrom</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>floppy</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>lun</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='bus'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>fdc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sata</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </disk>
Nov 15 23:11:16 user nova-compute[76391]:     <graphics supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='type'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>sdl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vnc</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>spice</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egl-headless</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </graphics>
Nov 15 23:11:16 user nova-compute[76391]:     <video supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='modelType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>cirrus</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>vmvga</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>qxl</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>none</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>bochs</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>ramfb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </video>
Nov 15 23:11:16 user nova-compute[76391]:     <hostdev supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='mode'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>subsystem</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='startupPolicy'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>default</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>mandatory</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>requisite</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>optional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='subsysType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>usb</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>pci</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>scsi</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='capsType'/>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='pciBackend'/>
Nov 15 23:11:16 user nova-compute[76391]:     </hostdev>
Nov 15 23:11:16 user nova-compute[76391]:     <rng supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtio-non-transitional</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>random</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>egd</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>builtin</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </rng>
Nov 15 23:11:16 user nova-compute[76391]:     <filesystem supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='driverType'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>path</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>handle</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>virtiofs</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </filesystem>
Nov 15 23:11:16 user nova-compute[76391]:     <tpm supported='yes'>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='model'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-tis</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>tpm-crb</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:       <enum name='backendModel'>
Nov 15 23:11:16 user nova-compute[76391]:         <value>passthrough</value>
Nov 15 23:11:16 user nova-compute[76391]:         <value>emulator</value>
Nov 15 23:11:16 user nova-compute[76391]:       </enum>
Nov 15 23:11:16 user nova-compute[76391]:     </tpm>
Nov 15 23:11:16 user nova-compute[76391]:   </devices>
Nov 15 23:11:16 user nova-compute[76391]:   <features>
Nov 15 23:11:16 user nova-compute[76391]:     <gic supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:     <vmcoreinfo supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <genid supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backingStoreInput supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <backup supported='yes'/>
Nov 15 23:11:16 user nova-compute[76391]:     <sev supported='no'/>
Nov 15 23:11:16 user nova-compute[76391]:   </features>
Nov 15 23:11:16 user nova-compute[76391]: </domainCapabilities>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=76391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=76391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Checking secure boot support for host arch (x86_64) {{(pid=76391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Checking secure boot support for host arch (x86_64) {{(pid=76391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Checking secure boot support for host arch (x86_64) {{(pid=76391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Checking secure boot support for host arch (x86_64) {{(pid=76391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Checking secure boot support for host arch (x86_64) {{(pid=76391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 23:11:16 user nova-compute[76391]: INFO nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Secure Boot support detected
Nov 15 23:11:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] cpu compare xml: <cpu match="exact">
Nov 15 23:11:16 user nova-compute[76391]:   <model>Nehalem</model>
Nov 15 23:11:16 user nova-compute[76391]: </cpu>
Nov 15 23:11:16 user nova-compute[76391]:  {{(pid=76391) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 23:11:16 user nova-compute[76391]: INFO nova.virt.node [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Generated node identity 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3
Nov 15 23:11:16 user nova-compute[76391]: INFO nova.virt.node [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Wrote node identity 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 to /opt/stack/data/nova/compute_id
Nov 15 23:11:16 user nova-compute[76391]: WARNING nova.compute.manager [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Compute nodes ['5143780f-9ae3-45b9-9ec1-f2c0aa8048b3'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 23:11:16 user nova-compute[76391]: INFO nova.compute.manager [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 23:11:17 user nova-compute[76391]: WARNING nova.compute.manager [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 23:11:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:11:17 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:11:17 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Hypervisor/Node resource view: name=user free_ram=10946MB free_disk=26.125343322753906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:11:17 user nova-compute[76391]: WARNING nova.compute.resource_tracker [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] No compute node record for user:5143780f-9ae3-45b9-9ec1-f2c0aa8048b3: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 could not be found.
Nov 15 23:11:17 user nova-compute[76391]: INFO nova.compute.resource_tracker [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Compute node record created for user:user with uuid: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:11:17 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] [req-b92fe8ad-a169-443a-9dc0-a3927f1b3641] Created resource provider record via placement API for resource provider with UUID 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 and name user.
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=76391) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 23:11:17 user nova-compute[76391]: INFO nova.virt.libvirt.host [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] kernel doesn't support AMD SEV
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Libvirt baseline CPU <cpu>
Nov 15 23:11:17 user nova-compute[76391]:   <arch>x86_64</arch>
Nov 15 23:11:17 user nova-compute[76391]:   <model>Nehalem</model>
Nov 15 23:11:17 user nova-compute[76391]:   <vendor>Intel</vendor>
Nov 15 23:11:17 user nova-compute[76391]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 23:11:17 user nova-compute[76391]: </cpu>
Nov 15 23:11:17 user nova-compute[76391]:  {{(pid=76391) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Updated inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Updating resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 generation from 0 to 1 during operation: update_inventory {{(pid=76391) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Updating resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 generation from 1 to 2 during operation: update_traits {{(pid=76391) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:11:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:11:18 user nova-compute[76391]: DEBUG nova.service [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Creating RPC server for service compute {{(pid=76391) start /opt/stack/nova/nova/service.py:182}}
Nov 15 23:11:18 user nova-compute[76391]: DEBUG nova.service [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] Join ServiceGroup membership for this service compute {{(pid=76391) start /opt/stack/nova/nova/service.py:199}}
Nov 15 23:11:18 user nova-compute[76391]: DEBUG nova.servicegroup.drivers.db [None req-e4639698-80e8-457f-a1d3-7591a2226836 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=76391) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 23:11:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:11:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:12:08 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:12:08 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=10368MB free_disk=26.036808013916016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:12:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:13:08 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:13:09 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:13:09 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:13:09 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=26.101490020751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:09 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:13:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:14:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:14:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:14:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:14:09 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:14:10 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:14:10 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=10314MB free_disk=25.853633880615234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:14:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:14:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:14:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:15:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:15:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:15:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:15:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:12 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=9597MB free_disk=25.873531341552734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:15:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:15:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:19 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:19 user nova-compute[76391]: INFO nova.compute.claims [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Claim successful on node user
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:20 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:15:20 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Creating image(s)
Nov 15 23:15:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.part --force-share --output=json" returned: 0 in 0.160s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG nova.virt.images [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] 9fefdfab-50b0-4bb0-961e-aba7120d0851 was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.part /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG nova.policy [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323a9405e8854778bf826678f8ae876f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c28a381270e4f489acbbc7702c64c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.part /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.converted" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.254s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:21 user nova-compute[76391]: INFO oslo.privsep.daemon [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9emo7ylg/privsep.sock']
Nov 15 23:15:21 user sudo[85666]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9emo7ylg/privsep.sock
Nov 15 23:15:21 user sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 23:15:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:22 user nova-compute[76391]: INFO nova.compute.claims [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Claim successful on node user
Nov 15 23:15:22 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:23 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:23 user sudo[85666]: pam_unix(sudo:session): session closed for user root
Nov 15 23:15:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:15:23 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Creating image(s)
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "/opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "/opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "/opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:23 user nova-compute[76391]: INFO oslo.privsep.daemon [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Spawned new privsep daemon via rootwrap
Nov 15 23:15:23 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 23:15:23 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 23:15:23 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 23:15:23 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85677
Nov 15 23:15:23 user nova-compute[76391]: WARNING oslo_privsep.priv_context [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] privsep daemon already running
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG nova.policy [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9170a4bb51b41d289416bb371c98a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472379097b584f5da5aa8f5c919f2e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk 1073741824" returned: 0 in 0.039s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.216s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk 1073741824" returned: 0 in 0.122s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Cannot resize image /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Ensure instance console log exists: /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Cannot resize image /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Ensure instance console log exists: /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Successfully created port: 8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Successfully created port: a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Successfully updated port: 8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received event network-changed-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Refreshing instance network info cache due to event network-changed-8d742d76-5324-4921-9cf9-8f8487f04de5. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] Acquiring lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.network.neutron [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Instance network_info: |[{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] Acquired lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Refreshing network info cache for port 8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Start _get_guest_xml network_info=[{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:15:29 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:29 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-201123848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-201123848',id=1,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-7ofgkvjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:21Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=1e599e64-0ce6-4a2e-93c0-89add58a0c1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:45:b8,bridge_name='br-int',has_traffic_filtering=True,id=8d742d76-5324-4921-9cf9-8f8487f04de5,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d742d76-53') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.objects.instance [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:15:29 user nova-compute[76391]:   <uuid>1e599e64-0ce6-4a2e-93c0-89add58a0c1a</uuid>
Nov 15 23:15:29 user nova-compute[76391]:   <name>instance-00000001</name>
Nov 15 23:15:29 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:15:29 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:15:29 user nova-compute[76391]:   <metadata>
Nov 15 23:15:29 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:15:29 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:15:29 user nova-compute[76391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-201123848</nova:name>
Nov 15 23:15:29 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:15:29</nova:creationTime>
Nov 15 23:15:29 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:15:29 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:15:29 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:15:29 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:15:29 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:15:29 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:15:29 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:15:29 user nova-compute[76391]:       <nova:owner>
Nov 15 23:15:29 user nova-compute[76391]:         <nova:user uuid="323a9405e8854778bf826678f8ae876f">tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member</nova:user>
Nov 15 23:15:29 user nova-compute[76391]:         <nova:project uuid="9c28a381270e4f489acbbc7702c64c61">tempest-ServerBootFromVolumeStableRescueTest-194934661</nova:project>
Nov 15 23:15:29 user nova-compute[76391]:       </nova:owner>
Nov 15 23:15:29 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:15:29 user nova-compute[76391]:       <nova:ports>
Nov 15 23:15:29 user nova-compute[76391]:         <nova:port uuid="8d742d76-5324-4921-9cf9-8f8487f04de5">
Nov 15 23:15:29 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:15:29 user nova-compute[76391]:         </nova:port>
Nov 15 23:15:29 user nova-compute[76391]:       </nova:ports>
Nov 15 23:15:29 user nova-compute[76391]:     </nova:instance>
Nov 15 23:15:29 user nova-compute[76391]:   </metadata>
Nov 15 23:15:29 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:15:29 user nova-compute[76391]:     <system>
Nov 15 23:15:29 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:15:29 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:15:29 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:15:29 user nova-compute[76391]:       <entry name="serial">1e599e64-0ce6-4a2e-93c0-89add58a0c1a</entry>
Nov 15 23:15:29 user nova-compute[76391]:       <entry name="uuid">1e599e64-0ce6-4a2e-93c0-89add58a0c1a</entry>
Nov 15 23:15:29 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:15:29 user nova-compute[76391]:     </system>
Nov 15 23:15:29 user nova-compute[76391]:   </sysinfo>
Nov 15 23:15:29 user nova-compute[76391]:   <os>
Nov 15 23:15:29 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:15:29 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:15:29 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:15:29 user nova-compute[76391]:   </os>
Nov 15 23:15:29 user nova-compute[76391]:   <features>
Nov 15 23:15:29 user nova-compute[76391]:     <acpi/>
Nov 15 23:15:29 user nova-compute[76391]:     <apic/>
Nov 15 23:15:29 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:15:29 user nova-compute[76391]:   </features>
Nov 15 23:15:29 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:15:29 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:15:29 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:15:29 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:15:29 user nova-compute[76391]:   </clock>
Nov 15 23:15:29 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:15:29 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:15:29 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:15:29 user nova-compute[76391]:   </cpu>
Nov 15 23:15:29 user nova-compute[76391]:   <devices>
Nov 15 23:15:29 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:15:29 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:15:29 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk"/>
Nov 15 23:15:29 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:15:29 user nova-compute[76391]:     </disk>
Nov 15 23:15:29 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:15:29 user nova-compute[76391]:       <mac address="fa:16:3e:5c:45:b8"/>
Nov 15 23:15:29 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:29 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:15:29 user nova-compute[76391]:       <target dev="tap8d742d76-53"/>
Nov 15 23:15:29 user nova-compute[76391]:     </interface>
Nov 15 23:15:29 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:15:29 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/console.log" append="off"/>
Nov 15 23:15:29 user nova-compute[76391]:     </serial>
Nov 15 23:15:29 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:15:29 user nova-compute[76391]:     <video>
Nov 15 23:15:29 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:29 user nova-compute[76391]:     </video>
Nov 15 23:15:29 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:15:29 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:15:29 user nova-compute[76391]:     </rng>
Nov 15 23:15:29 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:15:29 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:15:29 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:15:29 user nova-compute[76391]:     </memballoon>
Nov 15 23:15:29 user nova-compute[76391]:   </devices>
Nov 15 23:15:29 user nova-compute[76391]: </domain>
Nov 15 23:15:29 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-201123848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-201123848',id=1,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-7ofgkvjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:21Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=1e599e64-0ce6-4a2e-93c0-89add58a0c1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:45:b8,bridge_name='br-int',has_traffic_filtering=True,id=8d742d76-5324-4921-9cf9-8f8487f04de5,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d742d76-53') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:29 user nova-compute[76391]: DEBUG os_vif [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:45:b8,bridge_name='br-int',has_traffic_filtering=True,id=8d742d76-5324-4921-9cf9-8f8487f04de5,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d742d76-53') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Created schema index Interface.name {{(pid=76391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Created schema index Port.name {{(pid=76391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Created schema index Bridge.name {{(pid=76391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [POLLOUT] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5609a8e1-09a2-58b0-afa9-dc106ea04322', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:30 user nova-compute[76391]: INFO oslo.privsep.daemon [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmphzpg13ty/privsep.sock']
Nov 15 23:15:30 user sudo[85739]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmphzpg13ty/privsep.sock
Nov 15 23:15:30 user sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 23:15:30 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Successfully updated port: a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquired lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-changed-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Refreshing instance network info cache due to event network-changed-a0e36bda-f671-4e95-8488-e500b017cbb4. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] Acquiring lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:30 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:31 user nova-compute[76391]: DEBUG nova.network.neutron [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updated VIF entry in instance network info cache for port 8d742d76-5324-4921-9cf9-8f8487f04de5. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:15:31 user nova-compute[76391]: DEBUG nova.network.neutron [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cdbc24ee-583b-44e6-bcf6-b8062a66b324 req-2528f64d-8bec-47dd-90c4-4639707a559f service nova] Releasing lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:31 user sudo[85739]: pam_unix(sudo:session): session closed for user root
Nov 15 23:15:31 user nova-compute[76391]: INFO oslo.privsep.daemon [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Spawned new privsep daemon via rootwrap
Nov 15 23:15:31 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 23:15:31 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 23:15:31 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 23:15:31 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85787
Nov 15 23:15:31 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Releasing lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Instance network_info: |[{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] Acquired lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.network.neutron [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Refreshing network info cache for port a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Start _get_guest_xml network_info=[{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:32 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-203507033',display_name='tempest-ServerActionsTestOtherA-server-203507033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-203507033',id=2,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-dosqdayd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=6626d0d5-79ae-433b-aa6f-94e69353c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:71,bridge_name='br-int',has_traffic_filtering=True,id=a0e36bda-f671-4e95-8488-e500b017cbb4,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e36bda-f6') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'pci_devices' on Instance uuid 6626d0d5-79ae-433b-aa6f-94e69353c7d3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:15:32 user nova-compute[76391]:   <uuid>6626d0d5-79ae-433b-aa6f-94e69353c7d3</uuid>
Nov 15 23:15:32 user nova-compute[76391]:   <name>instance-00000002</name>
Nov 15 23:15:32 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:15:32 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:15:32 user nova-compute[76391]:   <metadata>
Nov 15 23:15:32 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:15:32 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:15:32 user nova-compute[76391]:       <nova:name>tempest-ServerActionsTestOtherA-server-203507033</nova:name>
Nov 15 23:15:32 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:15:32</nova:creationTime>
Nov 15 23:15:32 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:15:32 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:15:32 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:15:32 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:15:32 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:15:32 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:15:32 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:15:32 user nova-compute[76391]:       <nova:owner>
Nov 15 23:15:32 user nova-compute[76391]:         <nova:user uuid="c9170a4bb51b41d289416bb371c98a3b">tempest-ServerActionsTestOtherA-1370446029-project-member</nova:user>
Nov 15 23:15:32 user nova-compute[76391]:         <nova:project uuid="472379097b584f5da5aa8f5c919f2e82">tempest-ServerActionsTestOtherA-1370446029</nova:project>
Nov 15 23:15:32 user nova-compute[76391]:       </nova:owner>
Nov 15 23:15:32 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:15:32 user nova-compute[76391]:       <nova:ports>
Nov 15 23:15:32 user nova-compute[76391]:         <nova:port uuid="a0e36bda-f671-4e95-8488-e500b017cbb4">
Nov 15 23:15:32 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 23:15:32 user nova-compute[76391]:         </nova:port>
Nov 15 23:15:32 user nova-compute[76391]:       </nova:ports>
Nov 15 23:15:32 user nova-compute[76391]:     </nova:instance>
Nov 15 23:15:32 user nova-compute[76391]:   </metadata>
Nov 15 23:15:32 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:15:32 user nova-compute[76391]:     <system>
Nov 15 23:15:32 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:15:32 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:15:32 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:15:32 user nova-compute[76391]:       <entry name="serial">6626d0d5-79ae-433b-aa6f-94e69353c7d3</entry>
Nov 15 23:15:32 user nova-compute[76391]:       <entry name="uuid">6626d0d5-79ae-433b-aa6f-94e69353c7d3</entry>
Nov 15 23:15:32 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:15:32 user nova-compute[76391]:     </system>
Nov 15 23:15:32 user nova-compute[76391]:   </sysinfo>
Nov 15 23:15:32 user nova-compute[76391]:   <os>
Nov 15 23:15:32 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:15:32 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:15:32 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:15:32 user nova-compute[76391]:   </os>
Nov 15 23:15:32 user nova-compute[76391]:   <features>
Nov 15 23:15:32 user nova-compute[76391]:     <acpi/>
Nov 15 23:15:32 user nova-compute[76391]:     <apic/>
Nov 15 23:15:32 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:15:32 user nova-compute[76391]:   </features>
Nov 15 23:15:32 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:15:32 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:15:32 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:15:32 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:15:32 user nova-compute[76391]:   </clock>
Nov 15 23:15:32 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:15:32 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:15:32 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:15:32 user nova-compute[76391]:   </cpu>
Nov 15 23:15:32 user nova-compute[76391]:   <devices>
Nov 15 23:15:32 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:15:32 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:15:32 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk"/>
Nov 15 23:15:32 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:15:32 user nova-compute[76391]:     </disk>
Nov 15 23:15:32 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:15:32 user nova-compute[76391]:       <mac address="fa:16:3e:f5:5b:71"/>
Nov 15 23:15:32 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:32 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:15:32 user nova-compute[76391]:       <target dev="tapa0e36bda-f6"/>
Nov 15 23:15:32 user nova-compute[76391]:     </interface>
Nov 15 23:15:32 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:15:32 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/console.log" append="off"/>
Nov 15 23:15:32 user nova-compute[76391]:     </serial>
Nov 15 23:15:32 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:15:32 user nova-compute[76391]:     <video>
Nov 15 23:15:32 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:32 user nova-compute[76391]:     </video>
Nov 15 23:15:32 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:15:32 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:15:32 user nova-compute[76391]:     </rng>
Nov 15 23:15:32 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:15:32 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:15:32 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:15:32 user nova-compute[76391]:     </memballoon>
Nov 15 23:15:32 user nova-compute[76391]:   </devices>
Nov 15 23:15:32 user nova-compute[76391]: </domain>
Nov 15 23:15:32 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-203507033',display_name='tempest-ServerActionsTestOtherA-server-203507033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-203507033',id=2,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-dosqdayd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=6626d0d5-79ae-433b-aa6f-94e69353c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:71,bridge_name='br-int',has_traffic_filtering=True,id=a0e36bda-f671-4e95-8488-e500b017cbb4,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e36bda-f6') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG os_vif [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:71,bridge_name='br-int',has_traffic_filtering=True,id=a0e36bda-f671-4e95-8488-e500b017cbb4,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e36bda-f6') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ef8fc00-690f-58bc-a864-f6aae3b4e55b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0e36bda-f6, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0e36bda-f6, col_values=(('qos', UUID('7fa4c49f-47b7-4a54-9dc0-a44db34b1fe5')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0e36bda-f6, col_values=(('external_ids', {'iface-id': 'a0e36bda-f671-4e95-8488-e500b017cbb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5b:71', 'vm-uuid': '6626d0d5-79ae-433b-aa6f-94e69353c7d3'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: INFO os_vif [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5b:71,bridge_name='br-int',has_traffic_filtering=True,id=a0e36bda-f671-4e95-8488-e500b017cbb4,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e36bda-f6')
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d742d76-53, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d742d76-53, col_values=(('qos', UUID('57b8a11f-a922-4d91-9cfa-63cdf5bbc8bc')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d742d76-53, col_values=(('external_ids', {'iface-id': '8d742d76-5324-4921-9cf9-8f8487f04de5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:45:b8', 'vm-uuid': '1e599e64-0ce6-4a2e-93c0-89add58a0c1a'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:32 user nova-compute[76391]: INFO os_vif [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:45:b8,bridge_name='br-int',has_traffic_filtering=True,id=8d742d76-5324-4921-9cf9-8f8487f04de5,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d742d76-53')
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No VIF found with MAC fa:16:3e:f5:5b:71, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No VIF found with MAC fa:16:3e:5c:45:b8, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:15:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updated VIF entry in instance network info cache for port a0e36bda-f671-4e95-8488-e500b017cbb4. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:15:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-19455ecf-e358-46d7-9621-62a76747306f req-51566db0-137b-4c8e-9514-e7cbe5cbc370 service nova] Releasing lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:15:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Instance spawned successfully.
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-094bb31f-484c-4bfa-857b-94b248d4718e req-799e4055-5b2a-47f1-ba06-dbcc7dda5c63 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-094bb31f-484c-4bfa-857b-94b248d4718e req-799e4055-5b2a-47f1-ba06-dbcc7dda5c63 service nova] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-094bb31f-484c-4bfa-857b-94b248d4718e req-799e4055-5b2a-47f1-ba06-dbcc7dda5c63 service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-094bb31f-484c-4bfa-857b-94b248d4718e req-799e4055-5b2a-47f1-ba06-dbcc7dda5c63 service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-094bb31f-484c-4bfa-857b-94b248d4718e req-799e4055-5b2a-47f1-ba06-dbcc7dda5c63 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] No waiting events found dispatching network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:15:38 user nova-compute[76391]: WARNING nova.compute.manager [req-094bb31f-484c-4bfa-857b-94b248d4718e req-799e4055-5b2a-47f1-ba06-dbcc7dda5c63 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received unexpected event network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 for instance with vm_state building and task_state spawning.
Nov 15 23:15:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Instance spawned successfully.
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:38 user nova-compute[76391]: INFO nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Took 17.71 seconds to spawn the instance on the hypervisor.
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:15:38 user nova-compute[76391]: INFO nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Took 15.11 seconds to spawn the instance on the hypervisor.
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:15:38 user nova-compute[76391]: INFO nova.compute.manager [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Took 18.60 seconds to build instance.
Nov 15 23:15:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-89a04bd9-24aa-451f-b0cb-95f1b029834a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.937s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:38 user nova-compute[76391]: INFO nova.compute.manager [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Took 16.01 seconds to build instance.
Nov 15 23:15:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5418be65-667e-4ffc-b544-a3bc1aeecd08 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.198s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:39 user nova-compute[76391]: INFO nova.compute.claims [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Claim successful on node user
Nov 15 23:15:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:39 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:15:39 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Creating image(s)
Nov 15 23:15:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "/opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "/opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG nova.policy [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a69f501c85d14ba9a335d49127b2e534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36a5adda4e479884daa83ddb23d9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.228s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.215s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-55cc198d-3a5e-4f29-bb29-07d0e3e483e2 req-8eee1578-2648-45bd-ac62-7bbfa19dfb02 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-55cc198d-3a5e-4f29-bb29-07d0e3e483e2 req-8eee1578-2648-45bd-ac62-7bbfa19dfb02 service nova] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-55cc198d-3a5e-4f29-bb29-07d0e3e483e2 req-8eee1578-2648-45bd-ac62-7bbfa19dfb02 service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-55cc198d-3a5e-4f29-bb29-07d0e3e483e2 req-8eee1578-2648-45bd-ac62-7bbfa19dfb02 service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-55cc198d-3a5e-4f29-bb29-07d0e3e483e2 req-8eee1578-2648-45bd-ac62-7bbfa19dfb02 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] No waiting events found dispatching network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:15:40 user nova-compute[76391]: WARNING nova.compute.manager [req-55cc198d-3a5e-4f29-bb29-07d0e3e483e2 req-8eee1578-2648-45bd-ac62-7bbfa19dfb02 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received unexpected event network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 for instance with vm_state active and task_state None.
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk 1073741824" returned: 0 in 0.065s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.208s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Cannot resize image /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Ensure instance console log exists: /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Successfully created port: 5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:42 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:42 user nova-compute[76391]: INFO nova.compute.claims [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Claim successful on node user
Nov 15 23:15:43 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:43 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.827s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:15:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Creating image(s)
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "/opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "/opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:44 user nova-compute[76391]: INFO nova.compute.claims [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Claim successful on node user
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.244s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.policy [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '488d63e50e024da5b1ecdf87e2897dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3862491382874ad9921b68be04f08f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk 1073741824" returned: 0 in 0.092s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.190s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Successfully updated port: 5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquired lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-changed-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Refreshing instance network info cache due to event network-changed-5abf29b6-5d3c-44e5-963f-5152c4ef6b23. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] Acquiring lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Cannot resize image /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Ensure instance console log exists: /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.944s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.056s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:45 user nova-compute[76391]: INFO nova.compute.claims [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Claim successful on node user
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:45 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.policy [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '455bcb01ce974a3ea1e76e68d749ab65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bea310cd7c247c995446fca1b6e590b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:15:45 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Creating image(s)
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "/opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "/opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "/opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "83748adf5c966f1a55be3b1ed688c7b9610cb441" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "83748adf5c966f1a55be3b1ed688c7b9610cb441" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:45 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.930s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:46 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updating instance_info_cache with network_info: [{"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.part --force-share --output=json" returned: 0 in 0.259s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.images [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] 73853c66-7f22-4aaf-ad23-d26c56c4c809 was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.part /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Successfully created port: 5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Releasing lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Instance network_info: |[{"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:46 user nova-compute[76391]: INFO nova.virt.block_device [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Booting with volume fba4cc50-1dea-41a7-93f3-7c414425be67 at /dev/vda
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] Acquired lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Refreshing network info cache for port 5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Start _get_guest_xml network_info=[{"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:46 user nova-compute[76391]: INFO nova.compute.claims [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Claim successful on node user
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.policy [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ec4681c47a4458888403c64e96f59d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cf3b6665eb46cf93ec4b66f688dfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG os_brick.utils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:15:46 user nova-compute[76391]: INFO oslo.privsep.daemon [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp584oei82/privsep.sock']
Nov 15 23:15:46 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:46 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:15:46 user sudo[86134]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp584oei82/privsep.sock
Nov 15 23:15:46 user sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1453386048',display_name='tempest-VolumesAdminNegativeTest-server-1453386048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1453386048',id=3,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcLk6QvYzeO2n+IYkbo87dBd+OrEJL1Azdpa19HYDGuaeYaQHn/TdyagNBJz97hlfv7g8ZYlCxKTQzu8Q1r1mTCVYs6gHj80C9s0P3mrQYq15rFC9RTyNap3zggJNHJyw==',key_name='tempest-keypair-1120412013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36a5adda4e479884daa83ddb23d9da',ramdisk_id='',reservation_id='r-8t0iahhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2137202579',owner_user_name='tempest-VolumesAdminNegativeTest-2137202579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a69f501c85d14ba9a335d49127b2e534',uuid=5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converting VIF {"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1d:59,bridge_name='br-int',has_traffic_filtering=True,id=5abf29b6-5d3c-44e5-963f-5152c4ef6b23,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abf29b6-5d') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:15:46 user nova-compute[76391]:   <uuid>5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee</uuid>
Nov 15 23:15:46 user nova-compute[76391]:   <name>instance-00000003</name>
Nov 15 23:15:46 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:15:46 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:15:46 user nova-compute[76391]:   <metadata>
Nov 15 23:15:46 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:15:46 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:15:46 user nova-compute[76391]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1453386048</nova:name>
Nov 15 23:15:46 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:15:46</nova:creationTime>
Nov 15 23:15:46 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:15:46 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:15:46 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:15:46 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:15:46 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:15:46 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:15:46 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:15:46 user nova-compute[76391]:       <nova:owner>
Nov 15 23:15:46 user nova-compute[76391]:         <nova:user uuid="a69f501c85d14ba9a335d49127b2e534">tempest-VolumesAdminNegativeTest-2137202579-project-member</nova:user>
Nov 15 23:15:46 user nova-compute[76391]:         <nova:project uuid="5d36a5adda4e479884daa83ddb23d9da">tempest-VolumesAdminNegativeTest-2137202579</nova:project>
Nov 15 23:15:46 user nova-compute[76391]:       </nova:owner>
Nov 15 23:15:46 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:15:46 user nova-compute[76391]:       <nova:ports>
Nov 15 23:15:46 user nova-compute[76391]:         <nova:port uuid="5abf29b6-5d3c-44e5-963f-5152c4ef6b23">
Nov 15 23:15:46 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:15:46 user nova-compute[76391]:         </nova:port>
Nov 15 23:15:46 user nova-compute[76391]:       </nova:ports>
Nov 15 23:15:46 user nova-compute[76391]:     </nova:instance>
Nov 15 23:15:46 user nova-compute[76391]:   </metadata>
Nov 15 23:15:46 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:15:46 user nova-compute[76391]:     <system>
Nov 15 23:15:46 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:15:46 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:15:46 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:15:46 user nova-compute[76391]:       <entry name="serial">5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee</entry>
Nov 15 23:15:46 user nova-compute[76391]:       <entry name="uuid">5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee</entry>
Nov 15 23:15:46 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:15:46 user nova-compute[76391]:     </system>
Nov 15 23:15:46 user nova-compute[76391]:   </sysinfo>
Nov 15 23:15:46 user nova-compute[76391]:   <os>
Nov 15 23:15:46 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:15:46 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:15:46 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:15:46 user nova-compute[76391]:   </os>
Nov 15 23:15:46 user nova-compute[76391]:   <features>
Nov 15 23:15:46 user nova-compute[76391]:     <acpi/>
Nov 15 23:15:46 user nova-compute[76391]:     <apic/>
Nov 15 23:15:46 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:15:46 user nova-compute[76391]:   </features>
Nov 15 23:15:46 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:15:46 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:15:46 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:15:46 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:15:46 user nova-compute[76391]:   </clock>
Nov 15 23:15:46 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:15:46 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:15:46 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:15:46 user nova-compute[76391]:   </cpu>
Nov 15 23:15:46 user nova-compute[76391]:   <devices>
Nov 15 23:15:46 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:15:46 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:15:46 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk"/>
Nov 15 23:15:46 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:15:46 user nova-compute[76391]:     </disk>
Nov 15 23:15:46 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:15:46 user nova-compute[76391]:       <mac address="fa:16:3e:dd:1d:59"/>
Nov 15 23:15:46 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:46 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:15:46 user nova-compute[76391]:       <target dev="tap5abf29b6-5d"/>
Nov 15 23:15:46 user nova-compute[76391]:     </interface>
Nov 15 23:15:46 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:15:46 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/console.log" append="off"/>
Nov 15 23:15:46 user nova-compute[76391]:     </serial>
Nov 15 23:15:46 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:15:46 user nova-compute[76391]:     <video>
Nov 15 23:15:46 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:46 user nova-compute[76391]:     </video>
Nov 15 23:15:46 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:15:46 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:15:46 user nova-compute[76391]:     </rng>
Nov 15 23:15:46 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:15:46 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:15:46 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:15:46 user nova-compute[76391]:     </memballoon>
Nov 15 23:15:46 user nova-compute[76391]:   </devices>
Nov 15 23:15:46 user nova-compute[76391]: </domain>
Nov 15 23:15:46 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1453386048',display_name='tempest-VolumesAdminNegativeTest-server-1453386048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1453386048',id=3,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcLk6QvYzeO2n+IYkbo87dBd+OrEJL1Azdpa19HYDGuaeYaQHn/TdyagNBJz97hlfv7g8ZYlCxKTQzu8Q1r1mTCVYs6gHj80C9s0P3mrQYq15rFC9RTyNap3zggJNHJyw==',key_name='tempest-keypair-1120412013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36a5adda4e479884daa83ddb23d9da',ramdisk_id='',reservation_id='r-8t0iahhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2137202579',owner_user_name='tempest-VolumesAdminNegativeTest-2137202579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a69f501c85d14ba9a335d49127b2e534',uuid=5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converting VIF {"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1d:59,bridge_name='br-int',has_traffic_filtering=True,id=5abf29b6-5d3c-44e5-963f-5152c4ef6b23,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abf29b6-5d') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG os_vif [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1d:59,bridge_name='br-int',has_traffic_filtering=True,id=5abf29b6-5d3c-44e5-963f-5152c4ef6b23,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abf29b6-5d') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Successfully created port: 81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b66be7e5-11cf-5153-828c-40f1b031d626', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5abf29b6-5d, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5abf29b6-5d, col_values=(('qos', UUID('9ec1d9d6-de72-437c-b002-2cbc75621052')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5abf29b6-5d, col_values=(('external_ids', {'iface-id': '5abf29b6-5d3c-44e5-963f-5152c4ef6b23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:1d:59', 'vm-uuid': '5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.part /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.converted" returned: 0 in 0.403s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:47 user nova-compute[76391]: INFO os_vif [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1d:59,bridge_name='br-int',has_traffic_filtering=True,id=5abf29b6-5d3c-44e5-963f-5152c4ef6b23,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abf29b6-5d')
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] No VIF found with MAC fa:16:3e:dd:1d:59, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441.converted --force-share --output=json" returned: 0 in 0.277s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "83748adf5c966f1a55be3b1ed688c7b9610cb441" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.515s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441 --force-share --output=json" returned: 0 in 0.226s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "83748adf5c966f1a55be3b1ed688c7b9610cb441" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "83748adf5c966f1a55be3b1ed688c7b9610cb441" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441 --force-share --output=json" returned: 0 in 0.224s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441,backing_fmt=raw /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441,backing_fmt=raw /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk 1073741824" returned: 0 in 0.075s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "83748adf5c966f1a55be3b1ed688c7b9610cb441" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:15:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Creating image(s)
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.policy [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '538446003d4147a586ba8675a3fbef81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14a7df237f84c518de0804a57254975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Successfully updated port: 81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441 --force-share --output=json" returned: 0 in 0.294s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updated VIF entry in instance network info cache for port 5abf29b6-5d3c-44e5-963f-5152c4ef6b23. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updating instance_info_cache with network_info: [{"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-changed-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Refreshing instance network info cache due to event network-changed-81efae21-a14a-4c0e-8624-29fe2977d41d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] Acquiring lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] Acquired lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Refreshing network info cache for port 81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.263s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Successfully updated port: 5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ee51f118-2803-4b03-bb09-c7ce4d63c0c2 req-92dd75f9-ba12-4553-973b-43ba0893f23c service nova] Releasing lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquired lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Cannot resize image /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Ensure instance console log exists: /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-changed-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Refreshing instance network info cache due to event network-changed-5fadf7b5-53ec-43d7-9da2-4c09ee12427f. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] Acquiring lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:48 user sudo[86134]: pam_unix(sudo:session): session closed for user root
Nov 15 23:15:48 user nova-compute[76391]: INFO oslo.privsep.daemon [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Spawned new privsep daemon via rootwrap
Nov 15 23:15:48 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 23:15:48 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 23:15:48 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 23:15:48 user nova-compute[76391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86206
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.216s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0476191d-53ea-4065-8572-e4be6429a464]: (2,) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk 1073741824" returned: 0 in 0.058s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.203s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db67ed6f-08cf-4769-ad28-1e509ebd4a1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:15:48 user nova-compute[76391]: WARNING os_brick.initiator.connectors.nvmeof [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ab7a2-3442-4da1-833f-2e73d5b4b39c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d1817f-06da-4935-906d-bd98607e7dc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7b416-30f5-4325-ac7b-2a90958e5535]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Successfully created port: b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:15:48 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:15:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a9e167-4b20-4270-a6d7-8f5e3ef57a1c]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:15:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG os_brick.utils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] <== get_connector_properties: return (2192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updating existing volume attachment record: 10e9591a-ab39-4930-8e89-1b68754b6d47 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Cannot resize image /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Ensure instance console log exists: /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.neutron [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a21a3f0b-2a89-4426-846a-fcc67d0e42be req-f4292c75-c711-4a8b-8e81-a6bcf8a74159 service nova] Releasing lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquired lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.neutron [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.neutron [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Updating instance_info_cache with network_info: [{"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Releasing lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Instance network_info: |[{"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] Acquired lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.neutron [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Refreshing network info cache for port 5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Start _get_guest_xml network_info=[{"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:15:49 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:49 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1367467545',display_name='tempest-TestVolumeSwap-server-1367467545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1367467545',id=4,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuHKKREin+Yf3H03ELdK5t42I5a9bQe4h5jIUsbKtKBvxQUICIJIJJNSjwRCy5GK5SoK862G2D94XBdmjcXLMc5y6e5Y3i1k2EPVUwXIub8C3U6WmZE6SekExH3FlarIA==',key_name='tempest-keypair-1337232033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3862491382874ad9921b68be04f08f15',ramdisk_id='',reservation_id='r-9o8goyt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-765121085',owner_user_name='tempest-TestVolumeSwap-765121085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488d63e50e024da5b1ecdf87e2897dce',uuid=cfe1ee59-af8a-479e-a77d-1c7af3ba30fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Converting VIF {"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:29:30,bridge_name='br-int',has_traffic_filtering=True,id=5fadf7b5-53ec-43d7-9da2-4c09ee12427f,network=Network(3c567556-02de-4aa1-8dae-61cb21537719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fadf7b5-53') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lazy-loading 'pci_devices' on Instance uuid cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:15:49 user nova-compute[76391]:   <uuid>cfe1ee59-af8a-479e-a77d-1c7af3ba30fa</uuid>
Nov 15 23:15:49 user nova-compute[76391]:   <name>instance-00000004</name>
Nov 15 23:15:49 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:15:49 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:15:49 user nova-compute[76391]:   <metadata>
Nov 15 23:15:49 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:15:49 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:15:49 user nova-compute[76391]:       <nova:name>tempest-TestVolumeSwap-server-1367467545</nova:name>
Nov 15 23:15:49 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:15:49</nova:creationTime>
Nov 15 23:15:49 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:15:49 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:15:49 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:15:49 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:15:49 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:15:49 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:15:49 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:15:49 user nova-compute[76391]:       <nova:owner>
Nov 15 23:15:49 user nova-compute[76391]:         <nova:user uuid="488d63e50e024da5b1ecdf87e2897dce">tempest-TestVolumeSwap-765121085-project-member</nova:user>
Nov 15 23:15:49 user nova-compute[76391]:         <nova:project uuid="3862491382874ad9921b68be04f08f15">tempest-TestVolumeSwap-765121085</nova:project>
Nov 15 23:15:49 user nova-compute[76391]:       </nova:owner>
Nov 15 23:15:49 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:15:49 user nova-compute[76391]:       <nova:ports>
Nov 15 23:15:49 user nova-compute[76391]:         <nova:port uuid="5fadf7b5-53ec-43d7-9da2-4c09ee12427f">
Nov 15 23:15:49 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:15:49 user nova-compute[76391]:         </nova:port>
Nov 15 23:15:49 user nova-compute[76391]:       </nova:ports>
Nov 15 23:15:49 user nova-compute[76391]:     </nova:instance>
Nov 15 23:15:49 user nova-compute[76391]:   </metadata>
Nov 15 23:15:49 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:15:49 user nova-compute[76391]:     <system>
Nov 15 23:15:49 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:15:49 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:15:49 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:15:49 user nova-compute[76391]:       <entry name="serial">cfe1ee59-af8a-479e-a77d-1c7af3ba30fa</entry>
Nov 15 23:15:49 user nova-compute[76391]:       <entry name="uuid">cfe1ee59-af8a-479e-a77d-1c7af3ba30fa</entry>
Nov 15 23:15:49 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:15:49 user nova-compute[76391]:     </system>
Nov 15 23:15:49 user nova-compute[76391]:   </sysinfo>
Nov 15 23:15:49 user nova-compute[76391]:   <os>
Nov 15 23:15:49 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:15:49 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:15:49 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:15:49 user nova-compute[76391]:   </os>
Nov 15 23:15:49 user nova-compute[76391]:   <features>
Nov 15 23:15:49 user nova-compute[76391]:     <acpi/>
Nov 15 23:15:49 user nova-compute[76391]:     <apic/>
Nov 15 23:15:49 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:15:49 user nova-compute[76391]:   </features>
Nov 15 23:15:49 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:15:49 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:15:49 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:15:49 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:15:49 user nova-compute[76391]:   </clock>
Nov 15 23:15:49 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:15:49 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:15:49 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:15:49 user nova-compute[76391]:   </cpu>
Nov 15 23:15:49 user nova-compute[76391]:   <devices>
Nov 15 23:15:49 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:15:49 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:15:49 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk"/>
Nov 15 23:15:49 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:15:49 user nova-compute[76391]:     </disk>
Nov 15 23:15:49 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:15:49 user nova-compute[76391]:       <mac address="fa:16:3e:99:29:30"/>
Nov 15 23:15:49 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:49 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:15:49 user nova-compute[76391]:       <target dev="tap5fadf7b5-53"/>
Nov 15 23:15:49 user nova-compute[76391]:     </interface>
Nov 15 23:15:49 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:15:49 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/console.log" append="off"/>
Nov 15 23:15:49 user nova-compute[76391]:     </serial>
Nov 15 23:15:49 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:15:49 user nova-compute[76391]:     <video>
Nov 15 23:15:49 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:49 user nova-compute[76391]:     </video>
Nov 15 23:15:49 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:15:49 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:15:49 user nova-compute[76391]:     </rng>
Nov 15 23:15:49 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:15:49 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:15:49 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:15:49 user nova-compute[76391]:     </memballoon>
Nov 15 23:15:49 user nova-compute[76391]:   </devices>
Nov 15 23:15:49 user nova-compute[76391]: </domain>
Nov 15 23:15:49 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1367467545',display_name='tempest-TestVolumeSwap-server-1367467545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1367467545',id=4,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuHKKREin+Yf3H03ELdK5t42I5a9bQe4h5jIUsbKtKBvxQUICIJIJJNSjwRCy5GK5SoK862G2D94XBdmjcXLMc5y6e5Y3i1k2EPVUwXIub8C3U6WmZE6SekExH3FlarIA==',key_name='tempest-keypair-1337232033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3862491382874ad9921b68be04f08f15',ramdisk_id='',reservation_id='r-9o8goyt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-765121085',owner_user_name='tempest-TestVolumeSwap-765121085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488d63e50e024da5b1ecdf87e2897dce',uuid=cfe1ee59-af8a-479e-a77d-1c7af3ba30fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Converting VIF {"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:29:30,bridge_name='br-int',has_traffic_filtering=True,id=5fadf7b5-53ec-43d7-9da2-4c09ee12427f,network=Network(3c567556-02de-4aa1-8dae-61cb21537719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fadf7b5-53') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG os_vif [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:29:30,bridge_name='br-int',has_traffic_filtering=True,id=5fadf7b5-53ec-43d7-9da2-4c09ee12427f,network=Network(3c567556-02de-4aa1-8dae-61cb21537719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fadf7b5-53') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e486210-87ac-5c34-892d-b39e132b17ad', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fadf7b5-53, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fadf7b5-53, col_values=(('qos', UUID('ee6712d0-7d83-42ed-a1a6-d855798f77ad')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fadf7b5-53, col_values=(('external_ids', {'iface-id': '5fadf7b5-53ec-43d7-9da2-4c09ee12427f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:29:30', 'vm-uuid': 'cfe1ee59-af8a-479e-a77d-1c7af3ba30fa'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:49 user nova-compute[76391]: INFO os_vif [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:29:30,bridge_name='br-int',has_traffic_filtering=True,id=5fadf7b5-53ec-43d7-9da2-4c09ee12427f,network=Network(3c567556-02de-4aa1-8dae-61cb21537719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fadf7b5-53')
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] No VIF found with MAC fa:16:3e:99:29:30, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:15:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.neutron [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Updating instance_info_cache with network_info: [{"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Releasing lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Instance network_info: |[{"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Start _get_guest_xml network_info=[{"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:15:34Z,direct_url=<?>,disk_format='qcow2',id=73853c66-7f22-4aaf-ad23-d26c56c4c809,min_disk=0,min_ram=0,name='',owner='61b8f6f555b545428252f59684ff21c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:15:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '73853c66-7f22-4aaf-ad23-d26c56c4c809'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Successfully created port: 9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:50 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:50 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:15:34Z,direct_url=<?>,disk_format='qcow2',id=73853c66-7f22-4aaf-ad23-d26c56c4c809,min_disk=0,min_ram=0,name='',owner='61b8f6f555b545428252f59684ff21c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:15:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-151591415',display_name='tempest-AttachSCSIVolumeTestJSON-server-151591415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-151591415',id=5,image_ref='73853c66-7f22-4aaf-ad23-d26c56c4c809',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEwWX8sLYjYMIPxG4KJbvoLuv5oic4QOmSA1HLgtMUCTmv9VzbyZ+VHKWMPv8Tb/nqZAkgLy932fzYjg3hOvMpxRZblFdHXeKahR+jyemIgkMWRXnGSCFYQGUrFCPuuYA==',key_name='tempest-keypair-694647929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bea310cd7c247c995446fca1b6e590b',ramdisk_id='',reservation_id='r-7p7i01g2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73853c66-7f22-4aaf-ad23-d26c56c4c809',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-979196840',owner_user_name='tempest-AttachSCSIVolumeTestJSON-979196840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='455bcb01ce974a3ea1e76e68d749ab65',uuid=eba711fe-61e2-4fc1-97cd-1b7322c95173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Converting VIF {"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=81efae21-a14a-4c0e-8624-29fe2977d41d,network=Network(d96de21a-bfba-42b8-bcc7-92d826362bf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81efae21-a1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.objects.instance [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lazy-loading 'pci_devices' on Instance uuid eba711fe-61e2-4fc1-97cd-1b7322c95173 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] No waiting events found dispatching network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:15:50 user nova-compute[76391]: WARNING nova.compute.manager [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received unexpected event network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 for instance with vm_state building and task_state spawning.
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] No waiting events found dispatching network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:15:50 user nova-compute[76391]: WARNING nova.compute.manager [req-cf97bc09-cf93-4882-8ea4-e5f773f8c08a req-7375395e-b8bb-4773-bdfe-7985aa94809b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received unexpected event network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 for instance with vm_state building and task_state spawning.
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:15:50 user nova-compute[76391]:   <uuid>eba711fe-61e2-4fc1-97cd-1b7322c95173</uuid>
Nov 15 23:15:50 user nova-compute[76391]:   <name>instance-00000005</name>
Nov 15 23:15:50 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:15:50 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:15:50 user nova-compute[76391]:   <metadata>
Nov 15 23:15:50 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:15:50 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:15:50 user nova-compute[76391]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-151591415</nova:name>
Nov 15 23:15:50 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:15:50</nova:creationTime>
Nov 15 23:15:50 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:15:50 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:15:50 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:15:50 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:15:50 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:15:50 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:15:50 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:15:50 user nova-compute[76391]:       <nova:owner>
Nov 15 23:15:50 user nova-compute[76391]:         <nova:user uuid="455bcb01ce974a3ea1e76e68d749ab65">tempest-AttachSCSIVolumeTestJSON-979196840-project-member</nova:user>
Nov 15 23:15:50 user nova-compute[76391]:         <nova:project uuid="8bea310cd7c247c995446fca1b6e590b">tempest-AttachSCSIVolumeTestJSON-979196840</nova:project>
Nov 15 23:15:50 user nova-compute[76391]:       </nova:owner>
Nov 15 23:15:50 user nova-compute[76391]:       <nova:root type="image" uuid="73853c66-7f22-4aaf-ad23-d26c56c4c809"/>
Nov 15 23:15:50 user nova-compute[76391]:       <nova:ports>
Nov 15 23:15:50 user nova-compute[76391]:         <nova:port uuid="81efae21-a14a-4c0e-8624-29fe2977d41d">
Nov 15 23:15:50 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:15:50 user nova-compute[76391]:         </nova:port>
Nov 15 23:15:50 user nova-compute[76391]:       </nova:ports>
Nov 15 23:15:50 user nova-compute[76391]:     </nova:instance>
Nov 15 23:15:50 user nova-compute[76391]:   </metadata>
Nov 15 23:15:50 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:15:50 user nova-compute[76391]:     <system>
Nov 15 23:15:50 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:15:50 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:15:50 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:15:50 user nova-compute[76391]:       <entry name="serial">eba711fe-61e2-4fc1-97cd-1b7322c95173</entry>
Nov 15 23:15:50 user nova-compute[76391]:       <entry name="uuid">eba711fe-61e2-4fc1-97cd-1b7322c95173</entry>
Nov 15 23:15:50 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:15:50 user nova-compute[76391]:     </system>
Nov 15 23:15:50 user nova-compute[76391]:   </sysinfo>
Nov 15 23:15:50 user nova-compute[76391]:   <os>
Nov 15 23:15:50 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:15:50 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:15:50 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:15:50 user nova-compute[76391]:   </os>
Nov 15 23:15:50 user nova-compute[76391]:   <features>
Nov 15 23:15:50 user nova-compute[76391]:     <acpi/>
Nov 15 23:15:50 user nova-compute[76391]:     <apic/>
Nov 15 23:15:50 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:15:50 user nova-compute[76391]:   </features>
Nov 15 23:15:50 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:15:50 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:15:50 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:15:50 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:15:50 user nova-compute[76391]:   </clock>
Nov 15 23:15:50 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:15:50 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:15:50 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:15:50 user nova-compute[76391]:   </cpu>
Nov 15 23:15:50 user nova-compute[76391]:   <devices>
Nov 15 23:15:50 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:15:50 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:15:50 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk"/>
Nov 15 23:15:50 user nova-compute[76391]:       <target dev="sda" bus="scsi"/>
Nov 15 23:15:50 user nova-compute[76391]:       <address type="drive" controller="0" unit="0"/>
Nov 15 23:15:50 user nova-compute[76391]:     </disk>
Nov 15 23:15:50 user nova-compute[76391]:     <disk type="file" device="cdrom">
Nov 15 23:15:50 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 23:15:50 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk.config"/>
Nov 15 23:15:50 user nova-compute[76391]:       <target dev="sdb" bus="scsi"/>
Nov 15 23:15:50 user nova-compute[76391]:       <address type="drive" controller="0" unit="1"/>
Nov 15 23:15:50 user nova-compute[76391]:     </disk>
Nov 15 23:15:50 user nova-compute[76391]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 23:15:50 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:15:50 user nova-compute[76391]:       <mac address="fa:16:3e:03:da:bd"/>
Nov 15 23:15:50 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:50 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:15:50 user nova-compute[76391]:       <target dev="tap81efae21-a1"/>
Nov 15 23:15:50 user nova-compute[76391]:     </interface>
Nov 15 23:15:50 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:15:50 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/console.log" append="off"/>
Nov 15 23:15:50 user nova-compute[76391]:     </serial>
Nov 15 23:15:50 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:15:50 user nova-compute[76391]:     <video>
Nov 15 23:15:50 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:50 user nova-compute[76391]:     </video>
Nov 15 23:15:50 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:15:50 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:15:50 user nova-compute[76391]:     </rng>
Nov 15 23:15:50 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:15:50 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:15:50 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:15:50 user nova-compute[76391]:     </memballoon>
Nov 15 23:15:50 user nova-compute[76391]:   </devices>
Nov 15 23:15:50 user nova-compute[76391]: </domain>
Nov 15 23:15:50 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-151591415',display_name='tempest-AttachSCSIVolumeTestJSON-server-151591415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-151591415',id=5,image_ref='73853c66-7f22-4aaf-ad23-d26c56c4c809',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEwWX8sLYjYMIPxG4KJbvoLuv5oic4QOmSA1HLgtMUCTmv9VzbyZ+VHKWMPv8Tb/nqZAkgLy932fzYjg3hOvMpxRZblFdHXeKahR+jyemIgkMWRXnGSCFYQGUrFCPuuYA==',key_name='tempest-keypair-694647929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bea310cd7c247c995446fca1b6e590b',ramdisk_id='',reservation_id='r-7p7i01g2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73853c66-7f22-4aaf-ad23-d26c56c4c809',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-979196840',owner_user_name='tempest-AttachSCSIVolumeTestJSON-979196840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='455bcb01ce974a3ea1e76e68d749ab65',uuid=eba711fe-61e2-4fc1-97cd-1b7322c95173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Converting VIF {"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=81efae21-a14a-4c0e-8624-29fe2977d41d,network=Network(d96de21a-bfba-42b8-bcc7-92d826362bf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81efae21-a1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG os_vif [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=81efae21-a14a-4c0e-8624-29fe2977d41d,network=Network(d96de21a-bfba-42b8-bcc7-92d826362bf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81efae21-a1') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62021b19-ba31-55cb-a8e5-107f8799ea93', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81efae21-a1, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81efae21-a1, col_values=(('qos', UUID('be954d89-67e3-4bc4-9212-4e64b28c3c3c')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81efae21-a1, col_values=(('external_ids', {'iface-id': '81efae21-a14a-4c0e-8624-29fe2977d41d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:da:bd', 'vm-uuid': 'eba711fe-61e2-4fc1-97cd-1b7322c95173'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:50 user nova-compute[76391]: INFO os_vif [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=81efae21-a14a-4c0e-8624-29fe2977d41d,network=Network(d96de21a-bfba-42b8-bcc7-92d826362bf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81efae21-a1')
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Updated VIF entry in instance network info cache for port 5fadf7b5-53ec-43d7-9da2-4c09ee12427f. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Updating instance_info_cache with network_info: [{"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-470df764-ca1d-4183-83d3-e73cd4052336 req-3b6fea02-880f-44d4-9d24-fa01e38e8623 service nova] Releasing lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] No BDM found with device name sda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] No VIF found with MAC fa:16:3e:03:da:bd, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:15:50 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Using config drive
Nov 15 23:15:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Successfully updated port: b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquired lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:15:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Instance spawned successfully.
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:51 user nova-compute[76391]: INFO nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Took 11.90 seconds to spawn the instance on the hypervisor.
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:15:51 user nova-compute[76391]: INFO nova.compute.manager [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Took 12.86 seconds to build instance.
Nov 15 23:15:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e6dffbef-f425-43da-945d-237bf5290a89 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.028s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-changed-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Refreshing instance network info cache due to event network-changed-b09aad63-4edf-494c-808a-4b0472dfdd18. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] Acquiring lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Creating config drive at /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk.config
Nov 15 23:15:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj_yr7de_ {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj_yr7de_" returned: 0 in 0.070s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Successfully updated port: 9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquired lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-changed-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Refreshing instance network info cache due to event network-changed-9722bca6-f5a9-46c2-81ab-f50b88433b28. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] Acquiring lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updating instance_info_cache with network_info: [{"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Releasing lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance network_info: |[{"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] Acquired lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Refreshing network info cache for port b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:15:53 user nova-compute[76391]: INFO nova.compute.claims [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Claim successful on node user
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updated VIF entry in instance network info cache for port b09aad63-4edf-494c-808a-4b0472dfdd18. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updating instance_info_cache with network_info: [{"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-95d907e4-7df4-45f8-85c6-67c0b84bbdc4 req-7ffa3d91-ebb2-49dd-9dd9-f19061a45fe3 service nova] Releasing lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:15:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.policy [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2af794740660401081cf6d7e38289bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5841417a1d4439c8059c788533b08b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:15:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Instance spawned successfully.
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:15:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Creating image(s)
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "/opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "/opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:54 user nova-compute[76391]: INFO nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Took 10.43 seconds to spawn the instance on the hypervisor.
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:15:54 user nova-compute[76391]: INFO nova.compute.manager [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Took 11.84 seconds to build instance.
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.261s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a084c7c7-8bf2-4098-95a6-16d50ec53211 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.017s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating instance_info_cache with network_info: [{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Releasing lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Instance network_info: |[{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] Acquired lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.network.neutron [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Refreshing network info cache for port 9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Start _get_guest_xml network_info=[{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:15:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:15:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392690336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392690336',id=7,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0IspOOwh4AxJxavAWXMIXxyzIMrl5nEywXM3UCkaIXrQ4id+z3X0cGmiwOi/O0sqc9uZ5aEcv3TENtVTyqVPRYbiCBkzRNPUHJ+VUjOn4PSSiaFmNQVRgZ33uNsYuXlQ==',key_name='tempest-keypair-210828776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14a7df237f84c518de0804a57254975',ramdisk_id='',reservation_id='r-kti4w7p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1986589477',owner_user_name='tempest-TaggedAttachmentsTest-1986589477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538446003d4147a586ba8675a3fbef81',uuid=a928dcdd-b214-4e5f-84e5-76633d313e4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converting VIF {"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:23:fb,bridge_name='br-int',has_traffic_filtering=True,id=9722bca6-f5a9-46c2-81ab-f50b88433b28,network=Network(c9d8f1d6-119e-4253-ba0c-5716f247e9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9722bca6-f5') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'pci_devices' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:15:55 user nova-compute[76391]:   <uuid>a928dcdd-b214-4e5f-84e5-76633d313e4b</uuid>
Nov 15 23:15:55 user nova-compute[76391]:   <name>instance-00000007</name>
Nov 15 23:15:55 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:15:55 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:15:55 user nova-compute[76391]:   <metadata>
Nov 15 23:15:55 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:15:55 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:15:55 user nova-compute[76391]:       <nova:name>tempest-device-tagging-server-392690336</nova:name>
Nov 15 23:15:55 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:15:54</nova:creationTime>
Nov 15 23:15:55 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:15:55 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:15:55 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:15:55 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:15:55 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:15:55 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:15:55 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:15:55 user nova-compute[76391]:       <nova:owner>
Nov 15 23:15:55 user nova-compute[76391]:         <nova:user uuid="538446003d4147a586ba8675a3fbef81">tempest-TaggedAttachmentsTest-1986589477-project-member</nova:user>
Nov 15 23:15:55 user nova-compute[76391]:         <nova:project uuid="e14a7df237f84c518de0804a57254975">tempest-TaggedAttachmentsTest-1986589477</nova:project>
Nov 15 23:15:55 user nova-compute[76391]:       </nova:owner>
Nov 15 23:15:55 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:15:55 user nova-compute[76391]:       <nova:ports>
Nov 15 23:15:55 user nova-compute[76391]:         <nova:port uuid="9722bca6-f5a9-46c2-81ab-f50b88433b28">
Nov 15 23:15:55 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:15:55 user nova-compute[76391]:         </nova:port>
Nov 15 23:15:55 user nova-compute[76391]:       </nova:ports>
Nov 15 23:15:55 user nova-compute[76391]:     </nova:instance>
Nov 15 23:15:55 user nova-compute[76391]:   </metadata>
Nov 15 23:15:55 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:15:55 user nova-compute[76391]:     <system>
Nov 15 23:15:55 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:15:55 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:15:55 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:15:55 user nova-compute[76391]:       <entry name="serial">a928dcdd-b214-4e5f-84e5-76633d313e4b</entry>
Nov 15 23:15:55 user nova-compute[76391]:       <entry name="uuid">a928dcdd-b214-4e5f-84e5-76633d313e4b</entry>
Nov 15 23:15:55 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:15:55 user nova-compute[76391]:     </system>
Nov 15 23:15:55 user nova-compute[76391]:   </sysinfo>
Nov 15 23:15:55 user nova-compute[76391]:   <os>
Nov 15 23:15:55 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:15:55 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:15:55 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:15:55 user nova-compute[76391]:   </os>
Nov 15 23:15:55 user nova-compute[76391]:   <features>
Nov 15 23:15:55 user nova-compute[76391]:     <acpi/>
Nov 15 23:15:55 user nova-compute[76391]:     <apic/>
Nov 15 23:15:55 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:15:55 user nova-compute[76391]:   </features>
Nov 15 23:15:55 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:15:55 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:15:55 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:15:55 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:15:55 user nova-compute[76391]:   </clock>
Nov 15 23:15:55 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:15:55 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:15:55 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:15:55 user nova-compute[76391]:   </cpu>
Nov 15 23:15:55 user nova-compute[76391]:   <devices>
Nov 15 23:15:55 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:15:55 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:15:55 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk"/>
Nov 15 23:15:55 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:15:55 user nova-compute[76391]:     </disk>
Nov 15 23:15:55 user nova-compute[76391]:     <disk type="file" device="cdrom">
Nov 15 23:15:55 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 23:15:55 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.config"/>
Nov 15 23:15:55 user nova-compute[76391]:       <target dev="hda" bus="ide"/>
Nov 15 23:15:55 user nova-compute[76391]:     </disk>
Nov 15 23:15:55 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:15:55 user nova-compute[76391]:       <mac address="fa:16:3e:fb:23:fb"/>
Nov 15 23:15:55 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:55 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:15:55 user nova-compute[76391]:       <target dev="tap9722bca6-f5"/>
Nov 15 23:15:55 user nova-compute[76391]:     </interface>
Nov 15 23:15:55 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:15:55 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/console.log" append="off"/>
Nov 15 23:15:55 user nova-compute[76391]:     </serial>
Nov 15 23:15:55 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:15:55 user nova-compute[76391]:     <video>
Nov 15 23:15:55 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:55 user nova-compute[76391]:     </video>
Nov 15 23:15:55 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:15:55 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:15:55 user nova-compute[76391]:     </rng>
Nov 15 23:15:55 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:15:55 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:15:55 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:15:55 user nova-compute[76391]:     </memballoon>
Nov 15 23:15:55 user nova-compute[76391]:   </devices>
Nov 15 23:15:55 user nova-compute[76391]: </domain>
Nov 15 23:15:55 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392690336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392690336',id=7,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0IspOOwh4AxJxavAWXMIXxyzIMrl5nEywXM3UCkaIXrQ4id+z3X0cGmiwOi/O0sqc9uZ5aEcv3TENtVTyqVPRYbiCBkzRNPUHJ+VUjOn4PSSiaFmNQVRgZ33uNsYuXlQ==',key_name='tempest-keypair-210828776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14a7df237f84c518de0804a57254975',ramdisk_id='',reservation_id='r-kti4w7p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1986589477',owner_user_name='tempest-TaggedAttachmentsTest-1986589477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538446003d4147a586ba8675a3fbef81',uuid=a928dcdd-b214-4e5f-84e5-76633d313e4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converting VIF {"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:23:fb,bridge_name='br-int',has_traffic_filtering=True,id=9722bca6-f5a9-46c2-81ab-f50b88433b28,network=Network(c9d8f1d6-119e-4253-ba0c-5716f247e9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9722bca6-f5') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG os_vif [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:23:fb,bridge_name='br-int',has_traffic_filtering=True,id=9722bca6-f5a9-46c2-81ab-f50b88433b28,network=Network(c9d8f1d6-119e-4253-ba0c-5716f247e9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9722bca6-f5') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.357s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4061c0fc-6e5b-523d-be99-d97669a9d266', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9722bca6-f5, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9722bca6-f5, col_values=(('qos', UUID('b6dbd5c7-c992-4d64-8f1e-e65f8520418d')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9722bca6-f5, col_values=(('external_ids', {'iface-id': '9722bca6-f5a9-46c2-81ab-f50b88433b28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:23:fb', 'vm-uuid': 'a928dcdd-b214-4e5f-84e5-76633d313e4b'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:55 user nova-compute[76391]: INFO os_vif [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:23:fb,bridge_name='br-int',has_traffic_filtering=True,id=9722bca6-f5a9-46c2-81ab-f50b88433b28,network=Network(c9d8f1d6-119e-4253-ba0c-5716f247e9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9722bca6-f5')
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk 1073741824" returned: 0 in 0.137s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.497s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.network.neutron [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Successfully created port: 1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No BDM found with device name hda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No VIF found with MAC fa:16:3e:fb:23:fb, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:15:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Using config drive
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.221s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Cannot resize image /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Ensure instance console log exists: /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Creating config drive at /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.config
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplx4ge4n5 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:15:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplx4ge4n5" returned: 0 in 0.075s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.neutron [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updated VIF entry in instance network info cache for port 9722bca6-f5a9-46c2-81ab-f50b88433b28. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.neutron [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating instance_info_cache with network_info: [{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab525bcb-5644-45bf-9565-c1c7d3ed5f3e req-be5f530f-d1b2-4445-b80f-093481eae4e6 service nova] Releasing lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Successfully updated port: 1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "refresh_cache-2d140776-ced1-4f7a-8a28-ecc55d6a408b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquired lock "refresh_cache-2d140776-ced1-4f7a-8a28-ecc55d6a408b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received event network-changed-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Refreshing instance network info cache due to event network-changed-1bc5327f-7aa5-4508-9165-29cc94dd906a. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] Acquiring lock "refresh_cache-2d140776-ced1-4f7a-8a28-ecc55d6a408b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Updating instance_info_cache with network_info: [{"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Releasing lock "refresh_cache-2d140776-ced1-4f7a-8a28-ecc55d6a408b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Instance network_info: |[{"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] Acquired lock "refresh_cache-2d140776-ced1-4f7a-8a28-ecc55d6a408b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.neutron [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Refreshing network info cache for port 1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Start _get_guest_xml network_info=[{"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:15:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1408701417',display_name='tempest-VolumesActionsTest-instance-1408701417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1408701417',id=8,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5841417a1d4439c8059c788533b08b9',ramdisk_id='',reservation_id='r-nn060bhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1618594309',owner_user_name='tempest-VolumesActionsTest-1618594309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:54Z,user_data=None,user_id='2af794740660401081cf6d7e38289bd0',uuid=2d140776-ced1-4f7a-8a28-ecc55d6a408b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converting VIF {"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=1bc5327f-7aa5-4508-9165-29cc94dd906a,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5327f-7a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.objects.instance [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d140776-ced1-4f7a-8a28-ecc55d6a408b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:15:56 user nova-compute[76391]:   <uuid>2d140776-ced1-4f7a-8a28-ecc55d6a408b</uuid>
Nov 15 23:15:56 user nova-compute[76391]:   <name>instance-00000008</name>
Nov 15 23:15:56 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:15:56 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:15:56 user nova-compute[76391]:   <metadata>
Nov 15 23:15:56 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:15:56 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:15:56 user nova-compute[76391]:       <nova:name>tempest-VolumesActionsTest-instance-1408701417</nova:name>
Nov 15 23:15:56 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:15:56</nova:creationTime>
Nov 15 23:15:56 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:15:56 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:15:56 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:15:56 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:15:56 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:15:56 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:15:56 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:15:56 user nova-compute[76391]:       <nova:owner>
Nov 15 23:15:56 user nova-compute[76391]:         <nova:user uuid="2af794740660401081cf6d7e38289bd0">tempest-VolumesActionsTest-1618594309-project-member</nova:user>
Nov 15 23:15:56 user nova-compute[76391]:         <nova:project uuid="b5841417a1d4439c8059c788533b08b9">tempest-VolumesActionsTest-1618594309</nova:project>
Nov 15 23:15:56 user nova-compute[76391]:       </nova:owner>
Nov 15 23:15:56 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:15:56 user nova-compute[76391]:       <nova:ports>
Nov 15 23:15:56 user nova-compute[76391]:         <nova:port uuid="1bc5327f-7aa5-4508-9165-29cc94dd906a">
Nov 15 23:15:56 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 23:15:56 user nova-compute[76391]:         </nova:port>
Nov 15 23:15:56 user nova-compute[76391]:       </nova:ports>
Nov 15 23:15:56 user nova-compute[76391]:     </nova:instance>
Nov 15 23:15:56 user nova-compute[76391]:   </metadata>
Nov 15 23:15:56 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:15:56 user nova-compute[76391]:     <system>
Nov 15 23:15:56 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:15:56 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:15:56 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:15:56 user nova-compute[76391]:       <entry name="serial">2d140776-ced1-4f7a-8a28-ecc55d6a408b</entry>
Nov 15 23:15:56 user nova-compute[76391]:       <entry name="uuid">2d140776-ced1-4f7a-8a28-ecc55d6a408b</entry>
Nov 15 23:15:56 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:15:56 user nova-compute[76391]:     </system>
Nov 15 23:15:56 user nova-compute[76391]:   </sysinfo>
Nov 15 23:15:56 user nova-compute[76391]:   <os>
Nov 15 23:15:56 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:15:56 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:15:56 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:15:56 user nova-compute[76391]:   </os>
Nov 15 23:15:56 user nova-compute[76391]:   <features>
Nov 15 23:15:56 user nova-compute[76391]:     <acpi/>
Nov 15 23:15:56 user nova-compute[76391]:     <apic/>
Nov 15 23:15:56 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:15:56 user nova-compute[76391]:   </features>
Nov 15 23:15:56 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:15:56 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:15:56 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:15:56 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:15:56 user nova-compute[76391]:   </clock>
Nov 15 23:15:56 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:15:56 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:15:56 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:15:56 user nova-compute[76391]:   </cpu>
Nov 15 23:15:56 user nova-compute[76391]:   <devices>
Nov 15 23:15:56 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:15:56 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:15:56 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk"/>
Nov 15 23:15:56 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:15:56 user nova-compute[76391]:     </disk>
Nov 15 23:15:56 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:15:56 user nova-compute[76391]:       <mac address="fa:16:3e:3a:a0:5e"/>
Nov 15 23:15:56 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:56 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:15:56 user nova-compute[76391]:       <target dev="tap1bc5327f-7a"/>
Nov 15 23:15:56 user nova-compute[76391]:     </interface>
Nov 15 23:15:56 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:15:56 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/console.log" append="off"/>
Nov 15 23:15:56 user nova-compute[76391]:     </serial>
Nov 15 23:15:56 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:15:56 user nova-compute[76391]:     <video>
Nov 15 23:15:56 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:15:56 user nova-compute[76391]:     </video>
Nov 15 23:15:56 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:15:56 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:15:56 user nova-compute[76391]:     </rng>
Nov 15 23:15:56 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:15:56 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:15:56 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:15:56 user nova-compute[76391]:     </memballoon>
Nov 15 23:15:56 user nova-compute[76391]:   </devices>
Nov 15 23:15:56 user nova-compute[76391]: </domain>
Nov 15 23:15:56 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1408701417',display_name='tempest-VolumesActionsTest-instance-1408701417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1408701417',id=8,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5841417a1d4439c8059c788533b08b9',ramdisk_id='',reservation_id='r-nn060bhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1618594309',owner_user_name='tempest-VolumesActionsTest-1618594309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:54Z,user_data=None,user_id='2af794740660401081cf6d7e38289bd0',uuid=2d140776-ced1-4f7a-8a28-ecc55d6a408b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converting VIF {"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=1bc5327f-7aa5-4508-9165-29cc94dd906a,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5327f-7a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG os_vif [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=1bc5327f-7aa5-4508-9165-29cc94dd906a,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5327f-7a') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82c77ab4-1337-57e7-a9f7-dad2a332fbc9', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Instance spawned successfully.
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bc5327f-7a, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bc5327f-7a, col_values=(('qos', UUID('f13e199d-ff3d-48ae-b8fd-6cb0de006865')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bc5327f-7a, col_values=(('external_ids', {'iface-id': '1bc5327f-7aa5-4508-9165-29cc94dd906a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:a0:5e', 'vm-uuid': '2d140776-ced1-4f7a-8a28-ecc55d6a408b'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:15:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:57 user nova-compute[76391]: INFO os_vif [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=1bc5327f-7aa5-4508-9165-29cc94dd906a,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5327f-7a')
Nov 15 23:15:57 user nova-compute[76391]: INFO nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Took 11.31 seconds to spawn the instance on the hypervisor.
Nov 15 23:15:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:15:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:15:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] No VIF found with MAC fa:16:3e:3a:a0:5e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:15:57 user nova-compute[76391]: INFO nova.compute.manager [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Took 12.75 seconds to build instance.
Nov 15 23:15:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65c62f26-c3d9-43ac-8e31-5c9c246d2530 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.926s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:15:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Updated VIF entry in instance network info cache for port 1bc5327f-7aa5-4508-9165-29cc94dd906a. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:15:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Updating instance_info_cache with network_info: [{"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:15:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aacd17a6-7867-49ef-925b-96b1925bbb19 req-a0833edd-17b4-4002-8ae7-9c037407eb92 service nova] Releasing lock "refresh_cache-2d140776-ced1-4f7a-8a28-ecc55d6a408b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:15:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:15:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:16:02 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Instance spawned successfully.
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:16:02 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Instance spawned successfully.
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:02 user nova-compute[76391]: INFO nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Took 14.42 seconds to spawn the instance on the hypervisor.
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:16:02 user nova-compute[76391]: INFO nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Took 8.09 seconds to spawn the instance on the hypervisor.
Nov 15 23:16:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:16:02 user nova-compute[76391]: INFO nova.compute.manager [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Took 16.02 seconds to build instance.
Nov 15 23:16:02 user nova-compute[76391]: INFO nova.compute.manager [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Took 9.38 seconds to build instance.
Nov 15 23:16:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c98e8aca-9e9b-404b-894e-511a3b3e843c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.187s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-251fe408-2eb5-494d-b9b0-3887464fa31c tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.633s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:16:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Creating image(s)
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Ensure instance console log exists: /opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Start _get_guest_xml network_info=[{"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb286b41-55ed-4a38-8e66-6edb5f0ccd0e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fba4cc50-1dea-41a7-93f3-7c414425be67', 'serial': 'fba4cc50-1dea-41a7-93f3-7c414425be67'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '10e9591a-ab39-4930-8e89-1b68754b6d47', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:16:03 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:03 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connector [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Factory for ISCSI on None {{(pid=76391) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:03 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:03 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:03 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5defb32-0ffd-4c30-9b7a-9f37097d5465]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:16:03 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cb1d73-2ae5-4d5b-a383-057bf5da8f23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67] added
Nov 15 23:16:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5793d28f-41d6-4f94-91c5-4d5d29078691]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e30ad5-b3e6-4a5c-876a-26f582f6c760]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtkNBJIq {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtkNBJIq" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ab1ed-5404-4797-9016-4718abf5db84]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xtkNBJIq'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7fcf4c-8bcd-46df-96db-24cf88be314e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f99173-24ac-4f1a-832a-f3a831e84ab8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:16:03 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:16:03 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:03 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:16:03 user nova-compute[76391]: 
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[665034e4-d9d6-4d87-a9da-39e4e076a5ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]
Nov 15 23:16:03 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.
Nov 15 23:16:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4891f8f-e94e-48ee-8102-35b1d0426fee]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60bbeed-2721-46a7-ab9e-62942c32f930]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2b525f-de2d-4d71-b13d-5fd0ac7a66b8]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:16:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26666666437393862', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666666437393862', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1185346505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1185346505',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgS5owXYTIhp2CyONYKVA6cDqle9QogIygYExxZVew6Eyp+xF5P9KjoNDuUWixbTD8FG5eY4YFl/RQGWgxPOIDDfU+kWnosaJaWDfsFFB/PSD6XOidlEmphF4w4bqLdug==',key_name='tempest-keypair-2000121693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cf3b6665eb46cf93ec4b66f688dfe4',ramdisk_id='',reservation_id='r-s984ualt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1456826566',owner_user_name='tempest-ServerActionsV293TestJSON-1456826566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec4681c47a4458888403c64e96f59d2',uuid=eb286b41-55ed-4a38-8e66-6edb5f0ccd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converting VIF {"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lazy-loading 'pci_devices' on Instance uuid eb286b41-55ed-4a38-8e66-6edb5f0ccd0e {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:16:05 user nova-compute[76391]:   <uuid>eb286b41-55ed-4a38-8e66-6edb5f0ccd0e</uuid>
Nov 15 23:16:05 user nova-compute[76391]:   <name>instance-00000006</name>
Nov 15 23:16:05 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:16:05 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:16:05 user nova-compute[76391]:   <metadata>
Nov 15 23:16:05 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:16:05 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:16:05 user nova-compute[76391]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1185346505</nova:name>
Nov 15 23:16:05 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:16:03</nova:creationTime>
Nov 15 23:16:05 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:16:05 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:16:05 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:16:05 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:16:05 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:16:05 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:16:05 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:16:05 user nova-compute[76391]:       <nova:owner>
Nov 15 23:16:05 user nova-compute[76391]:         <nova:user uuid="0ec4681c47a4458888403c64e96f59d2">tempest-ServerActionsV293TestJSON-1456826566-project-member</nova:user>
Nov 15 23:16:05 user nova-compute[76391]:         <nova:project uuid="99cf3b6665eb46cf93ec4b66f688dfe4">tempest-ServerActionsV293TestJSON-1456826566</nova:project>
Nov 15 23:16:05 user nova-compute[76391]:       </nova:owner>
Nov 15 23:16:05 user nova-compute[76391]:       <nova:ports>
Nov 15 23:16:05 user nova-compute[76391]:         <nova:port uuid="b09aad63-4edf-494c-808a-4b0472dfdd18">
Nov 15 23:16:05 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:16:05 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:05 user nova-compute[76391]:       </nova:ports>
Nov 15 23:16:05 user nova-compute[76391]:     </nova:instance>
Nov 15 23:16:05 user nova-compute[76391]:   </metadata>
Nov 15 23:16:05 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:16:05 user nova-compute[76391]:     <system>
Nov 15 23:16:05 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:16:05 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:16:05 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:16:05 user nova-compute[76391]:       <entry name="serial">eb286b41-55ed-4a38-8e66-6edb5f0ccd0e</entry>
Nov 15 23:16:05 user nova-compute[76391]:       <entry name="uuid">eb286b41-55ed-4a38-8e66-6edb5f0ccd0e</entry>
Nov 15 23:16:05 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:16:05 user nova-compute[76391]:     </system>
Nov 15 23:16:05 user nova-compute[76391]:   </sysinfo>
Nov 15 23:16:05 user nova-compute[76391]:   <os>
Nov 15 23:16:05 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:16:05 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:16:05 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:16:05 user nova-compute[76391]:   </os>
Nov 15 23:16:05 user nova-compute[76391]:   <features>
Nov 15 23:16:05 user nova-compute[76391]:     <acpi/>
Nov 15 23:16:05 user nova-compute[76391]:     <apic/>
Nov 15 23:16:05 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:16:05 user nova-compute[76391]:   </features>
Nov 15 23:16:05 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:16:05 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:16:05 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:16:05 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:16:05 user nova-compute[76391]:   </clock>
Nov 15 23:16:05 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:16:05 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:16:05 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:16:05 user nova-compute[76391]:   </cpu>
Nov 15 23:16:05 user nova-compute[76391]:   <devices>
Nov 15 23:16:05 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:16:05 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:16:05 user nova-compute[76391]:       <source dev="/dev/sdb"/>
Nov 15 23:16:05 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:16:05 user nova-compute[76391]:       <serial>fba4cc50-1dea-41a7-93f3-7c414425be67</serial>
Nov 15 23:16:05 user nova-compute[76391]:     </disk>
Nov 15 23:16:05 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:05 user nova-compute[76391]:       <mac address="fa:16:3e:96:ea:ad"/>
Nov 15 23:16:05 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:05 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:05 user nova-compute[76391]:       <target dev="tapb09aad63-4e"/>
Nov 15 23:16:05 user nova-compute[76391]:     </interface>
Nov 15 23:16:05 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:16:05 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e/console.log" append="off"/>
Nov 15 23:16:05 user nova-compute[76391]:     </serial>
Nov 15 23:16:05 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:16:05 user nova-compute[76391]:     <video>
Nov 15 23:16:05 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:05 user nova-compute[76391]:     </video>
Nov 15 23:16:05 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:16:05 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:16:05 user nova-compute[76391]:     </rng>
Nov 15 23:16:05 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:16:05 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:16:05 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:16:05 user nova-compute[76391]:     </memballoon>
Nov 15 23:16:05 user nova-compute[76391]:   </devices>
Nov 15 23:16:05 user nova-compute[76391]: </domain>
Nov 15 23:16:05 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1185346505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1185346505',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgS5owXYTIhp2CyONYKVA6cDqle9QogIygYExxZVew6Eyp+xF5P9KjoNDuUWixbTD8FG5eY4YFl/RQGWgxPOIDDfU+kWnosaJaWDfsFFB/PSD6XOidlEmphF4w4bqLdug==',key_name='tempest-keypair-2000121693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cf3b6665eb46cf93ec4b66f688dfe4',ramdisk_id='',reservation_id='r-s984ualt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1456826566',owner_user_name='tempest-ServerActionsV293TestJSON-1456826566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec4681c47a4458888403c64e96f59d2',uuid=eb286b41-55ed-4a38-8e66-6edb5f0ccd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converting VIF {"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG os_vif [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5ff7c9a-030e-5241-aeec-09c1c1ec198b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb09aad63-4e, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb09aad63-4e, col_values=(('qos', UUID('cff0924b-741b-4888-a618-f8db764b786d')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb09aad63-4e, col_values=(('external_ids', {'iface-id': 'b09aad63-4edf-494c-808a-4b0472dfdd18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ea:ad', 'vm-uuid': 'eb286b41-55ed-4a38-8e66-6edb5f0ccd0e'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:05 user nova-compute[76391]: INFO os_vif [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e')
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] No VIF found with MAC fa:16:3e:96:ea:ad, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:05 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:16:05 user nova-compute[76391]: INFO nova.compute.claims [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Claim successful on node user
Nov 15 23:16:06 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:16:06 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:16:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.934s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:06 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:16:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.network.neutron [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:16:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:16:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Creating image(s)
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "/opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "/opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.policy [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40af3c78ecbc4f95baf527a9b2e47108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1bca28b2b2248218eacc56f3a4bfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-35cf9c29-1508-4868-8292-ea51217cc1b5 req-5679b601-a0af-4c23-ab91-b261b2cb1f49 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-35cf9c29-1508-4868-8292-ea51217cc1b5 req-5679b601-a0af-4c23-ab91-b261b2cb1f49 service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-35cf9c29-1508-4868-8292-ea51217cc1b5 req-5679b601-a0af-4c23-ab91-b261b2cb1f49 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-35cf9c29-1508-4868-8292-ea51217cc1b5 req-5679b601-a0af-4c23-ab91-b261b2cb1f49 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-35cf9c29-1508-4868-8292-ea51217cc1b5 req-5679b601-a0af-4c23-ab91-b261b2cb1f49 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:07 user nova-compute[76391]: WARNING nova.compute.manager [req-35cf9c29-1508-4868-8292-ea51217cc1b5 req-5679b601-a0af-4c23-ab91-b261b2cb1f49 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received unexpected event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with vm_state building and task_state spawning.
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.268s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.225s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk 1073741824" returned: 0 in 0.067s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.278s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Cannot resize image /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Ensure instance console log exists: /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "091f63e7-0384-434c-be37-804b10e051fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:16:08 user nova-compute[76391]: INFO nova.compute.claims [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Claim successful on node user
Nov 15 23:16:08 user nova-compute[76391]: DEBUG nova.network.neutron [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Successfully created port: 8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.849s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-b529faea-9a8b-4473-85b3-764df115475b req-10056bb4-7846-4491-ae87-f46f45d74fcf service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b529faea-9a8b-4473-85b3-764df115475b req-10056bb4-7846-4491-ae87-f46f45d74fcf service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b529faea-9a8b-4473-85b3-764df115475b req-10056bb4-7846-4491-ae87-f46f45d74fcf service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b529faea-9a8b-4473-85b3-764df115475b req-10056bb4-7846-4491-ae87-f46f45d74fcf service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-b529faea-9a8b-4473-85b3-764df115475b req-10056bb4-7846-4491-ae87-f46f45d74fcf service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:09 user nova-compute[76391]: WARNING nova.compute.manager [req-b529faea-9a8b-4473-85b3-764df115475b req-10056bb4-7846-4491-ae87-f46f45d74fcf service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received unexpected event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with vm_state building and task_state spawning.
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:16:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.network.neutron [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Successfully updated port: 8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquired lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.network.neutron [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-changed-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Refreshing instance network info cache due to event network-changed-8be279d3-1083-450b-837f-9fab64339e5d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] Acquiring lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:10 user nova-compute[76391]: INFO nova.virt.block_device [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Booting with volume 96568a11-9a18-42f6-8c32-c80ff4171fc1 at /dev/vda
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.policy [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb5c3d1118e142af822c69e72958a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551c857542554b8a9421bea1a7a22de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG os_brick.utils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08f723-44ad-4ba7-9e5e-e796b4f64f3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7188b42a-1636-43cf-9bcb-50510aeacea3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance spawned successfully.
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c625410-74f7-4442-a00e-a685fa232247]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d99c25-5d92-4b1b-bb19-23f0082cfc4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:10 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f42528c-f440-4018-b8d6-85db47fed557]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG os_brick.utils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating existing volume attachment record: b65f95d6-ded0-4c4b-8ba3-28b0cbf30381 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Updating instance_info_cache with network_info: [{"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Releasing lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Instance network_info: |[{"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] Acquired lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.network.neutron [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Refreshing network info cache for port 8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Start _get_guest_xml network_info=[{"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:16:10 user nova-compute[76391]: INFO nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Took 7.44 seconds to spawn the instance on the hypervisor.
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:16:10 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:10 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Skipping network cache update for instance because it is Building. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Skipping network cache update for instance because it is Building. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 23:16:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Skipping network cache update for instance because it is Building. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-344974005',display_name='tempest-VolumesAssistedSnapshotsTest-server-344974005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-344974005',id=9,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKYI8HVfvy9KCxdeUNVJKHDok14HTpr5zkDyea3vEgio6yN4TRJB/XrtGS3eaeufsQdtHOqZRukhnFkAUFi6z6BfHT4K1x8GA4YQmqzeZlbskhW/NbSODm8jmyLecXcPA==',key_name='tempest-keypair-1334195819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bca28b2b2248218eacc56f3a4bfc07',ramdisk_id='',reservation_id='r-gidqel70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1818210341',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1818210341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40af3c78ecbc4f95baf527a9b2e47108',uuid=9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Converting VIF {"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f1:57,bridge_name='br-int',has_traffic_filtering=True,id=8be279d3-1083-450b-837f-9fab64339e5d,network=Network(2bbbade9-5b8e-4420-9753-6142ba8400a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be279d3-10') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:16:11 user nova-compute[76391]:   <uuid>9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4</uuid>
Nov 15 23:16:11 user nova-compute[76391]:   <name>instance-00000009</name>
Nov 15 23:16:11 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:16:11 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:16:11 user nova-compute[76391]:   <metadata>
Nov 15 23:16:11 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:16:11 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:16:11 user nova-compute[76391]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-344974005</nova:name>
Nov 15 23:16:11 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:16:10</nova:creationTime>
Nov 15 23:16:11 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:16:11 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:16:11 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:16:11 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:16:11 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:16:11 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:16:11 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:16:11 user nova-compute[76391]:       <nova:owner>
Nov 15 23:16:11 user nova-compute[76391]:         <nova:user uuid="40af3c78ecbc4f95baf527a9b2e47108">tempest-VolumesAssistedSnapshotsTest-1818210341-project-member</nova:user>
Nov 15 23:16:11 user nova-compute[76391]:         <nova:project uuid="c1bca28b2b2248218eacc56f3a4bfc07">tempest-VolumesAssistedSnapshotsTest-1818210341</nova:project>
Nov 15 23:16:11 user nova-compute[76391]:       </nova:owner>
Nov 15 23:16:11 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:16:11 user nova-compute[76391]:       <nova:ports>
Nov 15 23:16:11 user nova-compute[76391]:         <nova:port uuid="8be279d3-1083-450b-837f-9fab64339e5d">
Nov 15 23:16:11 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 23:16:11 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:11 user nova-compute[76391]:       </nova:ports>
Nov 15 23:16:11 user nova-compute[76391]:     </nova:instance>
Nov 15 23:16:11 user nova-compute[76391]:   </metadata>
Nov 15 23:16:11 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:16:11 user nova-compute[76391]:     <system>
Nov 15 23:16:11 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:16:11 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:16:11 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:16:11 user nova-compute[76391]:       <entry name="serial">9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4</entry>
Nov 15 23:16:11 user nova-compute[76391]:       <entry name="uuid">9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4</entry>
Nov 15 23:16:11 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:16:11 user nova-compute[76391]:     </system>
Nov 15 23:16:11 user nova-compute[76391]:   </sysinfo>
Nov 15 23:16:11 user nova-compute[76391]:   <os>
Nov 15 23:16:11 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:16:11 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:16:11 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:16:11 user nova-compute[76391]:   </os>
Nov 15 23:16:11 user nova-compute[76391]:   <features>
Nov 15 23:16:11 user nova-compute[76391]:     <acpi/>
Nov 15 23:16:11 user nova-compute[76391]:     <apic/>
Nov 15 23:16:11 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:16:11 user nova-compute[76391]:   </features>
Nov 15 23:16:11 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:16:11 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:16:11 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:16:11 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:16:11 user nova-compute[76391]:   </clock>
Nov 15 23:16:11 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:16:11 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:16:11 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:16:11 user nova-compute[76391]:   </cpu>
Nov 15 23:16:11 user nova-compute[76391]:   <devices>
Nov 15 23:16:11 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:16:11 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:16:11 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk"/>
Nov 15 23:16:11 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:16:11 user nova-compute[76391]:     </disk>
Nov 15 23:16:11 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:11 user nova-compute[76391]:       <mac address="fa:16:3e:df:f1:57"/>
Nov 15 23:16:11 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:11 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:11 user nova-compute[76391]:       <target dev="tap8be279d3-10"/>
Nov 15 23:16:11 user nova-compute[76391]:     </interface>
Nov 15 23:16:11 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:16:11 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/console.log" append="off"/>
Nov 15 23:16:11 user nova-compute[76391]:     </serial>
Nov 15 23:16:11 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:16:11 user nova-compute[76391]:     <video>
Nov 15 23:16:11 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:11 user nova-compute[76391]:     </video>
Nov 15 23:16:11 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:16:11 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:16:11 user nova-compute[76391]:     </rng>
Nov 15 23:16:11 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:16:11 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:16:11 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:16:11 user nova-compute[76391]:     </memballoon>
Nov 15 23:16:11 user nova-compute[76391]:   </devices>
Nov 15 23:16:11 user nova-compute[76391]: </domain>
Nov 15 23:16:11 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-344974005',display_name='tempest-VolumesAssistedSnapshotsTest-server-344974005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-344974005',id=9,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKYI8HVfvy9KCxdeUNVJKHDok14HTpr5zkDyea3vEgio6yN4TRJB/XrtGS3eaeufsQdtHOqZRukhnFkAUFi6z6BfHT4K1x8GA4YQmqzeZlbskhW/NbSODm8jmyLecXcPA==',key_name='tempest-keypair-1334195819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bca28b2b2248218eacc56f3a4bfc07',ramdisk_id='',reservation_id='r-gidqel70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1818210341',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1818210341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40af3c78ecbc4f95baf527a9b2e47108',uuid=9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Converting VIF {"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f1:57,bridge_name='br-int',has_traffic_filtering=True,id=8be279d3-1083-450b-837f-9fab64339e5d,network=Network(2bbbade9-5b8e-4420-9753-6142ba8400a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be279d3-10') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG os_vif [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f1:57,bridge_name='br-int',has_traffic_filtering=True,id=8be279d3-1083-450b-837f-9fab64339e5d,network=Network(2bbbade9-5b8e-4420-9753-6142ba8400a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be279d3-10') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '347fba63-7482-5290-972d-c0f71bc6207f', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:11 user nova-compute[76391]: INFO nova.compute.manager [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Took 25.68 seconds to build instance.
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8be279d3-10, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8be279d3-10, col_values=(('qos', UUID('895531ed-eca3-453f-b239-d6066ad1d97d')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8be279d3-10, col_values=(('external_ids', {'iface-id': '8be279d3-1083-450b-837f-9fab64339e5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:f1:57', 'vm-uuid': '9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:11 user nova-compute[76391]: INFO os_vif [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f1:57,bridge_name='br-int',has_traffic_filtering=True,id=8be279d3-1083-450b-837f-9fab64339e5d,network=Network(2bbbade9-5b8e-4420-9753-6142ba8400a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be279d3-10')
Nov 15 23:16:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3271daa-f476-41c8-a2b4-20d1032d4359 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.226s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] No VIF found with MAC fa:16:3e:df:f1:57, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully created port: 0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:16:11 user nova-compute[76391]: INFO nova.compute.claims [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Claim successful on node user
Nov 15 23:16:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-b302c0a0-b56c-4eec-a7ba-5de2e26493d5 req-74fae1ee-f7ce-4215-8a0f-bc5c4360422e service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received event network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b302c0a0-b56c-4eec-a7ba-5de2e26493d5 req-74fae1ee-f7ce-4215-8a0f-bc5c4360422e service nova] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b302c0a0-b56c-4eec-a7ba-5de2e26493d5 req-74fae1ee-f7ce-4215-8a0f-bc5c4360422e service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b302c0a0-b56c-4eec-a7ba-5de2e26493d5 req-74fae1ee-f7ce-4215-8a0f-bc5c4360422e service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-b302c0a0-b56c-4eec-a7ba-5de2e26493d5 req-74fae1ee-f7ce-4215-8a0f-bc5c4360422e service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] No waiting events found dispatching network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:12 user nova-compute[76391]: WARNING nova.compute.manager [req-b302c0a0-b56c-4eec-a7ba-5de2e26493d5 req-74fae1ee-f7ce-4215-8a0f-bc5c4360422e service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received unexpected event network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 for instance with vm_state active and task_state None.
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Updated VIF entry in instance network info cache for port 8be279d3-1083-450b-837f-9fab64339e5d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Updating instance_info_cache with network_info: [{"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-28c45082-d76c-4bec-a34f-7ffbbab0a3ec req-501bfeb0-2dbc-4e4c-a7fe-50b243dd5e8d service nova] Releasing lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully created port: e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.773s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.127s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:16:12 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:16:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully created port: dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:13 user nova-compute[76391]: INFO nova.virt.block_device [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Booting with volume b9a4f449-2580-4ec9-a586-48f4f6afbe66 at /dev/vda
Nov 15 23:16:13 user nova-compute[76391]: DEBUG nova.policy [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9eaef1c04dca4715b12604ae9ce3fdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f440a723149379e44f8fe5872e75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12177ae-825d-4206-991f-70d524e68fcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0dae10-8155-4a03-84b1-0b4820b7facb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ef807-bb70-4b8d-89bb-0f1251125942]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6ef21-fd09-4d2a-9bd1-533ee5485d41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:13 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6c22b-a489-4fc6-a9d4-7e4756f27b68]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating existing volume attachment record: 6ad50efd-0109-40fb-886d-e5aaa9032cfe {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully created port: daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received event network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] No waiting events found dispatching network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:14 user nova-compute[76391]: WARNING nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received unexpected event network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 for instance with vm_state active and task_state None.
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] No waiting events found dispatching network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:14 user nova-compute[76391]: WARNING nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received unexpected event network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f for instance with vm_state active and task_state None.
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] No waiting events found dispatching network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:14 user nova-compute[76391]: WARNING nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received unexpected event network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f for instance with vm_state active and task_state None.
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:14 user nova-compute[76391]: WARNING nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received unexpected event network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 for instance with vm_state active and task_state None.
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:14 user nova-compute[76391]: WARNING nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received unexpected event network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 for instance with vm_state active and task_state None.
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received event network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Acquiring lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] No waiting events found dispatching network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:14 user nova-compute[76391]: WARNING nova.compute.manager [req-1346813e-e5c1-4c98-ba98-a66a851189f6 req-33812ff3-3971-4d9d-8cda-542c98c889e1 service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received unexpected event network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a for instance with vm_state active and task_state None.
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully created port: e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully created port: 4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully created port: 181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully updated port: 0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-0004d2ba-aee3-4a77-8403-261d5583c6c0. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.network.neutron [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port 0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Instance spawned successfully.
Nov 15 23:16:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:16 user nova-compute[76391]: INFO nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Took 8.86 seconds to spawn the instance on the hypervisor.
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received event network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Acquiring lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] No waiting events found dispatching network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:16 user nova-compute[76391]: WARNING nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received unexpected event network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a for instance with vm_state active and task_state None.
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] No waiting events found dispatching network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:16 user nova-compute[76391]: WARNING nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received unexpected event network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d for instance with vm_state building and task_state spawning.
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] No waiting events found dispatching network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:16 user nova-compute[76391]: WARNING nova.compute.manager [req-d2eff5f1-34a4-4403-aac1-c1ed6776c19f req-85a987b8-a06b-463d-b32c-9329da56606f service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received unexpected event network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d for instance with vm_state building and task_state spawning.
Nov 15 23:16:16 user nova-compute[76391]: INFO nova.compute.manager [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Took 10.56 seconds to build instance.
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-83401e43-31c9-40a6-a032-29f947ab912d tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.733s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully created port: 23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c87f9a26-09d8-45e6-b74f-438b36e027c5 req-595b1fbc-015d-4cfe-b621-197fac341823 service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully updated port: ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully created port: 0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json" returned: 0 in 0.349s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:17 user nova-compute[76391]: INFO nova.virt.block_device [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Booting with volume de8cf20f-8bbe-4deb-b093-faaeea42d162 at /dev/vdb
Nov 15 23:16:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-ec59871c-d5a3-463d-9dfa-2ac51320172f. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG nova.network.neutron [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG os_brick.utils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b4f78-49d0-447e-a657-d48e10e6950e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.074s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8161edea-5b58-45f0-8e76-a29fcb39ba4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully created port: 79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG nova.network.neutron [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully updated port: fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7587MB free_disk=25.62737274169922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a980bf-54e5-417c-af69-deffe30df574]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bcca5d-31be-44c7-b2d0-c4fa91109c9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:19 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:16:19 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[587263d0-5329-4719-af80-268b4a345dbe]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG os_brick.utils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== get_connector_properties: return (892ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating existing volume attachment record: e5926d6a-faae-4be6-97ad-c5aaadb3242a {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d9358e64-d68a-4cb0-9609-e661576ee5a2 req-4b0a9470-dcd2-467d-8780-df6f96540989 service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance eba711fe-61e2-4fc1-97cd-1b7322c95173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance eb286b41-55ed-4a38-8e66-6edb5f0ccd0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a928dcdd-b214-4e5f-84e5-76633d313e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 2d140776-ced1-4f7a-8a28-ecc55d6a408b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 091f63e7-0384-434c-be37-804b10e051fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 737991f4-b661-45db-84ba-53dbb2dce7dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully updated port: e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.manager [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.compute.manager [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:16:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:20 user nova-compute[76391]: INFO nova.virt.block_device [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Booting with volume 26c74feb-a2d8-47af-82d6-4dfe4f5fe075 at /dev/vdb
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-fd442b84-7913-4d88-ac96-59504b433218. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.network.neutron [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully updated port: e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c6543-19ee-41c2-b1b2-c33e764bebd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c095f03c-adce-4030-94ab-5ade2f02c731]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6544b183-ce6e-4e9c-a692-d619a673eeb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e36f0-ed61-4464-9621-0ed6ef4a12b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.network.neutron [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:20 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b4c3b3-407f-437a-9c69-09305bf18935]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating existing volume attachment record: 6ced9fdf-6664-4312-937f-6f504a91c95e {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.network.neutron [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.597s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc941858-5412-4f87-9bb3-591d44c94f80 req-991ec8a1-e042-4320-864b-cfab9a7e6fff service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully updated port: f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG nova.network.neutron [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d0b1755-6c2f-4d58-8887-90a2d306f0e0 req-797feee9-3020-45ba-9bf4-c683e36e396f service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully updated port: c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully updated port: dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG nova.compute.manager [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG nova.compute.manager [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-f5491150-b755-4504-b002-f9739aa210df. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:21 user nova-compute[76391]: DEBUG nova.network.neutron [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully updated port: 181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.network.neutron [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-e7645a3b-6a94-4607-a6a0-8a3084909717. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.network.neutron [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.network.neutron [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.network.neutron [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-c14ea8b5-3068-477f-9885-4fdee03d5700. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.network.neutron [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully updated port: 23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] No waiting events found dispatching network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:23 user nova-compute[76391]: WARNING nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received unexpected event network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d for instance with vm_state active and task_state None.
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] No waiting events found dispatching network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:23 user nova-compute[76391]: WARNING nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received unexpected event network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d for instance with vm_state active and task_state None.
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-dbb10e67-350f-4f30-acb7-f1543260d9d6. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully updated port: 0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3cc274c8-65fc-481a-a31b-6cc4bfb45ac5 req-e8a19a1d-c757-41ad-b2f5-4dbb8abd7b80 service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-181986eb-bb11-4ed8-8caf-547adf633b2a. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port 181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1a3e0128-1ac5-45bb-8278-19ac88d187c3 req-6b381680-2dc2-4879-a5c3-55c7f15ce439 service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully updated port: daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-daed3ff7-f0b2-4a3c-a38a-bba4299814ed. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Successfully updated port: 79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-23884449-954b-4c2e-b9e0-7daa8f4936e4. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port 23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:25 user nova-compute[76391]: INFO nova.virt.block_device [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Booting with volume e0b36846-5933-4674-ada6-66cee9ee0a95 at /dev/vdc
Nov 15 23:16:25 user nova-compute[76391]: DEBUG os_brick.utils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71a1a2-f28d-4917-8673-16bcf5a1b545]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a38ab1-1d51-4a55-9406-65ef7f93667b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[334758db-c248-4bcc-bbb9-74dc1f7349dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23dae9a-2126-49a2-9d3c-dd6e6a1936fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:25 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8f3077-ab36-4e44-9578-c987c63aceeb]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG os_brick.utils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating existing volume attachment record: 1e4dde76-a2fc-4ff4-8975-97a44b7dcecd {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-0303a44c-9762-420c-bd6b-d9cacd015e7f. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port 0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17a80802-2a3c-408c-a03d-5757ff65c9d3 req-c6613138-0666-4aa0-b292-e63a09efa7d3 service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Successfully updated port: 4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3a62acac-c02e-4cc1-88d6-6270d79eaa04 req-f39df696-2f29-407e-9f25-10c00a3b36ee service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-79a4bdd9-1447-478f-8f4e-db233b27e8bf. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:26 user nova-compute[76391]: INFO nova.virt.block_device [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Booting with volume 36f873ae-23d9-4b7a-ba99-606763b5a9a9 at /dev/vdc
Nov 15 23:16:26 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[989358da-1e83-4ab6-914a-9a548da6ce1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd3ad0d-f4e6-43f3-acfb-baf33001c02a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3af60b7-d4ef-47db-92f7-27bbb1849ce1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b8954-01a3-4d11-9378-ba23d469e236]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:16:26 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[75684d58-da30-4e89-89c2-31a408da7892]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating existing volume attachment record: 4e600388-513c-4df0-9539-e99c2bf68790 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-4a99f526-77c1-4652-aa71-53c3fd056ed9. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance network_info: |[{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port 4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance network_info: |[{"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port 79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updated VIF entry in instance network info cache for port 4a99f526-77c1-4652-aa71-53c3fd056ed9. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:16:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-301c8fe9-5a66-4080-beaf-4e3b5b9a0847 req-dc8fdc43-42b7-466f-a1c9-a7ba5ce46aeb service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updated VIF entry in instance network info cache for port 79a4bdd9-1447-478f-8f4e-db233b27e8bf. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:16:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-77b2fa2a-a294-4b80-8cfb-378735d9b1c2 req-0ced1143-1d12-4f05-a4c1-de2da4521967 service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:16:31 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Creating image(s)
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Ensure instance console log exists: /opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Start _get_guest_xml network_info=[{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNxRzHfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '091f63e7-0384-434c-be37-804b10e051fb', 'attached_at': '', 'detached_at': '', 'volume_id': '96568a11-9a18-42f6-8c32-c80ff4171fc1', 'serial': '96568a11-9a18-42f6-8c32-c80ff4171fc1'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'b65f95d6-ded0-4c4b-8ba3-28b0cbf30381', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdOaMbVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '091f63e7-0384-434c-be37-804b10e051fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'de8cf20f-8bbe-4deb-b093-faaeea42d162', 'serial': 'de8cf20f-8bbe-4deb-b093-faaeea42d162'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': 'e5926d6a-faae-4be6-97ad-c5aaadb3242a', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opGhQJVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '091f63e7-0384-434c-be37-804b10e051fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0b36846-5933-4674-ada6-66cee9ee0a95', 'serial': 'e0b36846-5933-4674-ada6-66cee9ee0a95'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '1e4dde76-a2fc-4ff4-8975-97a44b7dcecd', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:16:31 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:31 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNxRzHfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:31 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:31 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:31 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075d045-2b08-4164-ae97-5e1e23c6fec2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:16:31 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b774366-dd97-4bff-a395-db939fe34b5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1] added
Nov 15 23:16:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b637fd9-2b12-49c7-ad76-6c9c326ea505]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7a3f1c-dd21-4cd5-9725-cc3f116b9c09]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNxRzHfS {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNxRzHfS" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f474b662-6251-4b64-902f-cf7f6f4afcbb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VNxRzHfS'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d2a35d-bf4a-4833-abc2-99234434ad60]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5150ab-d2bc-4bb1-b164-99b3a91b12be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb980670-decd-41e4-b4de-45dd7ee30566]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260]
Nov 15 23:16:31 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260] successful.
Nov 15 23:16:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da14906-8336-4f05-ab2a-76a64fa3819c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3906a0-53a0-420e-8a95-b7040a4c239d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:31 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:31 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d140c4-6302-4bb8-8070-5e6c8f748bd5]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNxRzHfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:16:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Creating image(s)
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Ensure instance console log exists: /opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Start _get_guest_xml network_info=[{"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJoDAvdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '737991f4-b661-45db-84ba-53dbb2dce7dc', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9a4f449-2580-4ec9-a586-48f4f6afbe66', 'serial': 'b9a4f449-2580-4ec9-a586-48f4f6afbe66'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '6ad50efd-0109-40fb-886d-e5aaa9032cfe', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfRlSWoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '737991f4-b661-45db-84ba-53dbb2dce7dc', 'attached_at': '', 'detached_at': '', 'volume_id': '26c74feb-a2d8-47af-82d6-4dfe4f5fe075', 'serial': '26c74feb-a2d8-47af-82d6-4dfe4f5fe075'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '6ced9fdf-6664-4312-937f-6f504a91c95e', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiGkqhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '737991f4-b661-45db-84ba-53dbb2dce7dc', 'attached_at': '', 'detached_at': '', 'volume_id': '36f873ae-23d9-4b7a-ba99-606763b5a9a9', 'serial': '36f873ae-23d9-4b7a-ba99-606763b5a9a9'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '4e600388-513c-4df0-9539-e99c2bf68790', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:16:32 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:32 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJoDAvdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:32 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26566383436353230', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566383436353230', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.126s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:32 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:32 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b585d74e-3e36-4ab3-b089-847e7c9cdad7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:16:32 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdOaMbVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:32 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee7cff6-08cb-453a-b53c-210c7b5ba8d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66] added
Nov 15 23:16:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984c6d2-83ce-410a-8309-1b8d10636759]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d570e9b-270c-4f8e-a88f-9c471beeb426]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJoDAvdG {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJoDAvdG" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804265d-be9e-40ea-b699-ecb9bbb664d3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJoDAvdG'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd614a6-f9f7-47e8-aabf-cb6f9f140528]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6200e60-394f-43ac-a444-030d11a15706]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:32 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:32 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ab177-f277-4957-a2e2-177fce581195]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260]
Nov 15 23:16:33 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260] successful.
Nov 15 23:16:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6313bdc1-5f66-4a73-9bc4-03e1e8d6290d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e5682b-d651-4848-bf00-fac1a5fcf7bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:33 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:33 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:33 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:33 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dd1633-5113-4152-9372-7d58fa303610]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJoDAvdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '26261613436353334', 'path': '/dev/sdd'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261613436353334', 'path': '/dev/sdd'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.283s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:34 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:34 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4837cbe6-2bf4-47e5-a22c-fe90f7e2683d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:16:34 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e91a6d-5a93-44c6-bf75-4e4e3be95272]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162] added
Nov 15 23:16:34 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfRlSWoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:34 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6c6c9-7336-4b6a-82a2-73eb00dcab1a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eb9002-b76f-4641-9952-b574be676456]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdOaMbVP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdOaMbVP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97755aa-cc2e-478f-b9a3-eddd8cafd301]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gdOaMbVP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89da294-2174-461f-9c86-e88113babcf4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e1d005-651d-4f24-a1b1-6660f53d7354]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e22d7-baef-436d-97ac-e09a15051aa5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260]
Nov 15 23:16:34 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260] successful.
Nov 15 23:16:34 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e1ea59-ea28-40fe-a084-b626be2fc7ca]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d8b190-6993-44d9-9d35-798cd43046cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:34 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6d8b33-f9e2-4841-bcf9-824ff42c50cd]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdOaMbVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:16:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== connect_volume: return (2601ms) {'type': 'block', 'scsi_wwn': '26433343763633630', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433343763633630', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.260s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:35 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:35 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opGhQJVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:35 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de062a26-5fd3-4346-bd9a-5f9312809bbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:16:35 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26261bfe-c7b5-458d-bce3-cb2bcfb29127]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075] added
Nov 15 23:16:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[407d89bc-b55a-4da9-ac10-fe8651e0790a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cdc65e-afb3-444c-8ba7-b62a872ee475]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AfRlSWoB {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AfRlSWoB" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d9f1f-d97d-455d-8909-5abb7423af66]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AfRlSWoB'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[376cd847-a400-4f9e-9e3f-22693810aea4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b893fb-6888-4da0-9e08-da880e038a5e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d17f26-9964-405b-bff8-d4d879a816e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260]
Nov 15 23:16:35 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260] successful.
Nov 15 23:16:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0792ac2-4570-4ec2-b5a0-5159f587ea4c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f91a02-abbf-442c-b84e-931593df2301]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35cdf59-9005-4351-a704-47cdff70bb14]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfRlSWoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== connect_volume: return (2585ms) {'type': 'block', 'scsi_wwn': '23861343662343635', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861343662343635', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.303s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:36 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiGkqhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:16:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3232620c-7ec1-424a-a712-c9d2544fbcd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:16:36 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[624b5816-b418-4e75-ab0f-6d0119a596a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95] added
Nov 15 23:16:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f527398-f755-4125-a01e-35b62a82d9f3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f17a961-c058-42e6-bc35-b24fd8bc7460]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opGhQJVb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opGhQJVb" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02838e11-76b0-446b-a18e-eb54ec9598d9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opGhQJVb'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc7734e-7b36-4d5c-b8d7-10a2679fdf23]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e8c136-007e-4692-a716-ab217084681f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e6699d-467d-4bd8-a545-e29b953f7cef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260]
Nov 15 23:16:37 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260] successful.
Nov 15 23:16:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8df80e-c4bc-4687-8f90-3c044e805b2e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[032167c6-8055-4078-8345-1e576a5d8346]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:16:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ff571c-d214-4bc7-8f62-64476ca8318e]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opGhQJVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== connect_volume: return (2658ms) {'type': 'block', 'scsi_wwn': '26365383637643863', 'path': '/dev/sdg'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365383637643863', 'path': '/dev/sdg'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.328s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:38 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[347ab487-bb2b-46ff-9a67-85208ae8a3df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:16:38 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:58:86,bridge_name='br-int',has_traffic_filtering=True,id=0004d2ba-aee3-4a77-8403-261d5583c6c0,network=Network(480bdc42-ddd7-47f5-9b90-2319d029d7b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0004d2ba-ae') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ec59871c-d5a3-463d-9dfa-2ac51320172f,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec59871c-d5') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:eb:45,bridge_name='br-int',has_traffic_filtering=True,id=fd442b84-7913-4d88-ac96-59504b433218,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd442b84-79') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:50:5d,bridge_name='br-int',has_traffic_filtering=True,id=e7645a3b-6a94-4607-a6a0-8a3084909717,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7645a3b-6a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbb10e67-350f-4f30-acb7-f1543260d9d6,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb10e67-35') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:58:57,bridge_name='br-int',has_traffic_filtering=True,id=daed3ff7-f0b2-4a3c-a38a-bba4299814ed,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaed3ff7-f0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1d:a6,bridge_name='br-int',has_traffic_filtering=True,id=4a99f526-77c1-4652-aa71-53c3fd056ed9,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a99f526-77') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lazy-loading 'pci_devices' on Instance uuid 091f63e7-0384-434c-be37-804b10e051fb {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6958d0a1-59df-4888-ae0f-c21e6419e22b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9] added
Nov 15 23:16:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:16:38 user nova-compute[76391]:   <uuid>091f63e7-0384-434c-be37-804b10e051fb</uuid>
Nov 15 23:16:38 user nova-compute[76391]:   <name>instance-0000000a</name>
Nov 15 23:16:38 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:16:38 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:16:38 user nova-compute[76391]:   <metadata>
Nov 15 23:16:38 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:16:38 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:16:38 user nova-compute[76391]:       <nova:name>tempest-device-tagging-server-983889698</nova:name>
Nov 15 23:16:38 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:16:31</nova:creationTime>
Nov 15 23:16:38 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:16:38 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:16:38 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:16:38 user nova-compute[76391]:       <nova:owner>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:user uuid="cb5c3d1118e142af822c69e72958a213">tempest-TaggedBootDevicesTest-1775805296-project-member</nova:user>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:project uuid="551c857542554b8a9421bea1a7a22de5">tempest-TaggedBootDevicesTest-1775805296</nova:project>
Nov 15 23:16:38 user nova-compute[76391]:       </nova:owner>
Nov 15 23:16:38 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:16:38 user nova-compute[76391]:       <nova:ports>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:port uuid="0004d2ba-aee3-4a77-8403-261d5583c6c0">
Nov 15 23:16:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 23:16:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:port uuid="ec59871c-d5a3-463d-9dfa-2ac51320172f">
Nov 15 23:16:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.26" ipVersion="4"/>
Nov 15 23:16:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:port uuid="fd442b84-7913-4d88-ac96-59504b433218">
Nov 15 23:16:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Nov 15 23:16:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:port uuid="e7645a3b-6a94-4607-a6a0-8a3084909717">
Nov 15 23:16:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.95" ipVersion="4"/>
Nov 15 23:16:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:port uuid="dbb10e67-350f-4f30-acb7-f1543260d9d6">
Nov 15 23:16:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Nov 15 23:16:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:port uuid="daed3ff7-f0b2-4a3c-a38a-bba4299814ed">
Nov 15 23:16:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 23:16:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:38 user nova-compute[76391]:         <nova:port uuid="4a99f526-77c1-4652-aa71-53c3fd056ed9">
Nov 15 23:16:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 23:16:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:38 user nova-compute[76391]:       </nova:ports>
Nov 15 23:16:38 user nova-compute[76391]:     </nova:instance>
Nov 15 23:16:38 user nova-compute[76391]:   </metadata>
Nov 15 23:16:38 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:16:38 user nova-compute[76391]:     <system>
Nov 15 23:16:38 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:16:38 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:16:38 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:16:38 user nova-compute[76391]:       <entry name="serial">091f63e7-0384-434c-be37-804b10e051fb</entry>
Nov 15 23:16:38 user nova-compute[76391]:       <entry name="uuid">091f63e7-0384-434c-be37-804b10e051fb</entry>
Nov 15 23:16:38 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:16:38 user nova-compute[76391]:     </system>
Nov 15 23:16:38 user nova-compute[76391]:   </sysinfo>
Nov 15 23:16:38 user nova-compute[76391]:   <os>
Nov 15 23:16:38 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:16:38 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:16:38 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:16:38 user nova-compute[76391]:   </os>
Nov 15 23:16:38 user nova-compute[76391]:   <features>
Nov 15 23:16:38 user nova-compute[76391]:     <acpi/>
Nov 15 23:16:38 user nova-compute[76391]:     <apic/>
Nov 15 23:16:38 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:16:38 user nova-compute[76391]:   </features>
Nov 15 23:16:38 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:16:38 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:16:38 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:16:38 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:16:38 user nova-compute[76391]:   </clock>
Nov 15 23:16:38 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:16:38 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:16:38 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:16:38 user nova-compute[76391]:   </cpu>
Nov 15 23:16:38 user nova-compute[76391]:   <devices>
Nov 15 23:16:38 user nova-compute[76391]:     <disk type="file" device="cdrom">
Nov 15 23:16:38 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 23:16:38 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb/disk.config"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="hda" bus="ide"/>
Nov 15 23:16:38 user nova-compute[76391]:     </disk>
Nov 15 23:16:38 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:16:38 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:16:38 user nova-compute[76391]:       <source dev="/dev/sdc"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <serial>96568a11-9a18-42f6-8c32-c80ff4171fc1</serial>
Nov 15 23:16:38 user nova-compute[76391]:     </disk>
Nov 15 23:16:38 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:16:38 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:16:38 user nova-compute[76391]:       <source dev="/dev/sde"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <serial>de8cf20f-8bbe-4deb-b093-faaeea42d162</serial>
Nov 15 23:16:38 user nova-compute[76391]:     </disk>
Nov 15 23:16:38 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:16:38 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:16:38 user nova-compute[76391]:       <source dev="/dev/sdg"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="vdc" bus="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <serial>e0b36846-5933-4674-ada6-66cee9ee0a95</serial>
Nov 15 23:16:38 user nova-compute[76391]:     </disk>
Nov 15 23:16:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:38 user nova-compute[76391]:       <mac address="fa:16:3e:86:58:86"/>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="tap0004d2ba-ae"/>
Nov 15 23:16:38 user nova-compute[76391]:     </interface>
Nov 15 23:16:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:38 user nova-compute[76391]:       <mac address="fa:16:3e:6a:9d:8a"/>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="tapec59871c-d5"/>
Nov 15 23:16:38 user nova-compute[76391]:     </interface>
Nov 15 23:16:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:38 user nova-compute[76391]:       <mac address="fa:16:3e:c8:eb:45"/>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="tapfd442b84-79"/>
Nov 15 23:16:38 user nova-compute[76391]:     </interface>
Nov 15 23:16:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:38 user nova-compute[76391]:       <mac address="fa:16:3e:b8:50:5d"/>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="tape7645a3b-6a"/>
Nov 15 23:16:38 user nova-compute[76391]:     </interface>
Nov 15 23:16:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:38 user nova-compute[76391]:       <mac address="fa:16:3e:82:35:b3"/>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="tapdbb10e67-35"/>
Nov 15 23:16:38 user nova-compute[76391]:     </interface>
Nov 15 23:16:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:38 user nova-compute[76391]:       <mac address="fa:16:3e:3c:58:57"/>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="tapdaed3ff7-f0"/>
Nov 15 23:16:38 user nova-compute[76391]:     </interface>
Nov 15 23:16:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:38 user nova-compute[76391]:       <mac address="fa:16:3e:52:1d:a6"/>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:38 user nova-compute[76391]:       <target dev="tap4a99f526-77"/>
Nov 15 23:16:38 user nova-compute[76391]:     </interface>
Nov 15 23:16:38 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:16:38 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb/console.log" append="off"/>
Nov 15 23:16:38 user nova-compute[76391]:     </serial>
Nov 15 23:16:38 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:16:38 user nova-compute[76391]:     <video>
Nov 15 23:16:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:38 user nova-compute[76391]:     </video>
Nov 15 23:16:38 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:16:38 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:16:38 user nova-compute[76391]:     </rng>
Nov 15 23:16:38 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:16:38 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:16:38 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:16:38 user nova-compute[76391]:     </memballoon>
Nov 15 23:16:38 user nova-compute[76391]:   </devices>
Nov 15 23:16:38 user nova-compute[76391]: </domain>
Nov 15 23:16:38 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:58:86,bridge_name='br-int',has_traffic_filtering=True,id=0004d2ba-aee3-4a77-8403-261d5583c6c0,network=Network(480bdc42-ddd7-47f5-9b90-2319d029d7b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0004d2ba-ae') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:58:86,bridge_name='br-int',has_traffic_filtering=True,id=0004d2ba-aee3-4a77-8403-261d5583c6c0,network=Network(480bdc42-ddd7-47f5-9b90-2319d029d7b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0004d2ba-ae') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da54744-e72b-4917-b2c5-6ace597535a5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a46d731-2a54-5f65-aa3d-db742d3216de', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0004d2ba-ae, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0004d2ba-ae, col_values=(('qos', UUID('33b27647-b7b5-419f-b0e8-a94b4b9521e5')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0004d2ba-ae, col_values=(('external_ids', {'iface-id': '0004d2ba-aee3-4a77-8403-261d5583c6c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:58:86', 'vm-uuid': '091f63e7-0384-434c-be37-804b10e051fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc2fa7-5570-467a-8464-72bae15d57b1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QiGkqhOn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:58:86,bridge_name='br-int',has_traffic_filtering=True,id=0004d2ba-aee3-4a77-8403-261d5583c6c0,network=Network(480bdc42-ddd7-47f5-9b90-2319d029d7b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0004d2ba-ae')
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ec59871c-d5a3-463d-9dfa-2ac51320172f,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec59871c-d5') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ec59871c-d5a3-463d-9dfa-2ac51320172f,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec59871c-d5') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93c0d46c-b397-5a40-93b6-a2e181745560', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QiGkqhOn" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aac8105-613a-4d88-af25-602a598a9437]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QiGkqhOn'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec59871c-d5, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec59871c-d5, col_values=(('qos', UUID('d9f5880e-143c-4578-b660-ad49d9404677')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec59871c-d5, col_values=(('external_ids', {'iface-id': 'ec59871c-d5a3-463d-9dfa-2ac51320172f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:9d:8a', 'vm-uuid': '091f63e7-0384-434c-be37-804b10e051fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[879f6f7c-b546-48de-91fa-0309298520d5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ec59871c-d5a3-463d-9dfa-2ac51320172f,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec59871c-d5')
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:eb:45,bridge_name='br-int',has_traffic_filtering=True,id=fd442b84-7913-4d88-ac96-59504b433218,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd442b84-79') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:eb:45,bridge_name='br-int',has_traffic_filtering=True,id=fd442b84-7913-4d88-ac96-59504b433218,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd442b84-79') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1d6b8e3-f937-5a35-8120-625e7784dfee', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e78a6cd-e211-46f0-8160-9b7cb23179ea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd442b84-79, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd442b84-79, col_values=(('qos', UUID('6c6f0ddd-c06c-48cf-88ec-3cf88a7b4722')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd442b84-79, col_values=(('external_ids', {'iface-id': 'fd442b84-7913-4d88-ac96-59504b433218', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:eb:45', 'vm-uuid': '091f63e7-0384-434c-be37-804b10e051fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:eb:45,bridge_name='br-int',has_traffic_filtering=True,id=fd442b84-7913-4d88-ac96-59504b433218,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd442b84-79')
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:50:5d,bridge_name='br-int',has_traffic_filtering=True,id=e7645a3b-6a94-4607-a6a0-8a3084909717,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7645a3b-6a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:50:5d,bridge_name='br-int',has_traffic_filtering=True,id=e7645a3b-6a94-4607-a6a0-8a3084909717,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7645a3b-6a') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdb01cde-8c77-5730-9402-76ba3a0a659c', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f736f8a-40f4-4642-a82e-a9113b2eb23d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260]
Nov 15 23:16:38 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260] successful.
Nov 15 23:16:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7645a3b-6a, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7645a3b-6a, col_values=(('qos', UUID('65974e48-f08b-4427-861c-c57c97fc99b6')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7645a3b-6a, col_values=(('external_ids', {'iface-id': 'e7645a3b-6a94-4607-a6a0-8a3084909717', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:50:5d', 'vm-uuid': '091f63e7-0384-434c-be37-804b10e051fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69199f77-9a66-4fcb-afac-727613a821cf]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:50:5d,bridge_name='br-int',has_traffic_filtering=True,id=e7645a3b-6a94-4607-a6a0-8a3084909717,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7645a3b-6a')
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbb10e67-350f-4f30-acb7-f1543260d9d6,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb10e67-35') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbb10e67-350f-4f30-acb7-f1543260d9d6,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb10e67-35') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b863fd4b-b26c-5a98-839c-d5e434b299ff', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f1f74b-1934-4d8a-9cf7-06cd352358f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:16:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b5f283-90b5-48e3-af22-493081876993]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiGkqhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb10e67-35, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbb10e67-35, col_values=(('qos', UUID('5fa6846b-cada-424a-8682-89bf1032c9df')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbb10e67-35, col_values=(('external_ids', {'iface-id': 'dbb10e67-350f-4f30-acb7-f1543260d9d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:35:b3', 'vm-uuid': '091f63e7-0384-434c-be37-804b10e051fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbb10e67-350f-4f30-acb7-f1543260d9d6,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb10e67-35')
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:58:57,bridge_name='br-int',has_traffic_filtering=True,id=daed3ff7-f0b2-4a3c-a38a-bba4299814ed,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaed3ff7-f0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:58:57,bridge_name='br-int',has_traffic_filtering=True,id=daed3ff7-f0b2-4a3c-a38a-bba4299814ed,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaed3ff7-f0') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffa332f0-beae-58a1-9260-43131523079d', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaed3ff7-f0, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaed3ff7-f0, col_values=(('qos', UUID('018ec83a-6c25-409f-8511-bed110dee4ca')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaed3ff7-f0, col_values=(('external_ids', {'iface-id': 'daed3ff7-f0b2-4a3c-a38a-bba4299814ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:58:57', 'vm-uuid': '091f63e7-0384-434c-be37-804b10e051fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:58:57,bridge_name='br-int',has_traffic_filtering=True,id=daed3ff7-f0b2-4a3c-a38a-bba4299814ed,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaed3ff7-f0')
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1d:a6,bridge_name='br-int',has_traffic_filtering=True,id=4a99f526-77c1-4652-aa71-53c3fd056ed9,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a99f526-77') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1d:a6,bridge_name='br-int',has_traffic_filtering=True,id=4a99f526-77c1-4652-aa71-53c3fd056ed9,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a99f526-77') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0010714b-37ef-5b6d-b6d8-f356761e5e0e', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a99f526-77, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a99f526-77, col_values=(('qos', UUID('57377fdf-0deb-4996-a018-0d05d171d525')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a99f526-77, col_values=(('external_ids', {'iface-id': '4a99f526-77c1-4652-aa71-53c3fd056ed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:1d:a6', 'vm-uuid': '091f63e7-0384-434c-be37-804b10e051fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:38 user nova-compute[76391]: INFO os_vif [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1d:a6,bridge_name='br-int',has_traffic_filtering=True,id=4a99f526-77c1-4652-aa71-53c3fd056ed9,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a99f526-77')
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] No BDM found with device name hda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] No VIF found with MAC fa:16:3e:86:58:86, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:16:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] No VIF found with MAC fa:16:3e:82:35:b3, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:16:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Using config drive
Nov 15 23:16:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Creating config drive at /opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb/disk.config
Nov 15 23:16:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp63p5ni2n {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp63p5ni2n" returned: 0 in 0.053s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== connect_volume: return (2727ms) {'type': 'block', 'scsi_wwn': '23536303266663330', 'path': '/dev/sdh'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536303266663330', 'path': '/dev/sdh'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307,network=Network(d0fe1186-1629-4bc6-bc4f-fd520d149fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8af13a5-65') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d3:86,bridge_name='br-int',has_traffic_filtering=True,id=f5491150-b755-4504-b002-f9739aa210df,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5491150-b7') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=c14ea8b5-3068-477f-9885-4fdee03d5700,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc14ea8b5-30') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:e9:ed,bridge_name='br-int',has_traffic_filtering=True,id=181986eb-bb11-4ed8-8caf-547adf633b2a,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181986eb-bb') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=23884449-954b-4c2e-b9e0-7daa8f4936e4,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23884449-95') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b1:11,bridge_name='br-int',has_traffic_filtering=True,id=0303a44c-9762-420c-bd6b-d9cacd015e7f,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0303a44c-97') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=79a4bdd9-1447-478f-8f4e-db233b27e8bf,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a4bdd9-14') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lazy-loading 'pci_devices' on Instance uuid 737991f4-b661-45db-84ba-53dbb2dce7dc {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:16:39 user nova-compute[76391]:   <uuid>737991f4-b661-45db-84ba-53dbb2dce7dc</uuid>
Nov 15 23:16:39 user nova-compute[76391]:   <name>instance-0000000b</name>
Nov 15 23:16:39 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:16:39 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:16:39 user nova-compute[76391]:   <metadata>
Nov 15 23:16:39 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:16:39 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:16:39 user nova-compute[76391]:       <nova:name>tempest-device-tagging-server-208280662</nova:name>
Nov 15 23:16:39 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:16:32</nova:creationTime>
Nov 15 23:16:39 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:16:39 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:16:39 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:16:39 user nova-compute[76391]:       <nova:owner>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:user uuid="9eaef1c04dca4715b12604ae9ce3fdfa">tempest-TaggedBootDevicesTest_v242-1419769492-project-member</nova:user>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:project uuid="169f440a723149379e44f8fe5872e75d">tempest-TaggedBootDevicesTest_v242-1419769492</nova:project>
Nov 15 23:16:39 user nova-compute[76391]:       </nova:owner>
Nov 15 23:16:39 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:16:39 user nova-compute[76391]:       <nova:ports>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:port uuid="e8af13a5-65d2-4d9e-bfaf-1e7c514b9307">
Nov 15 23:16:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 23:16:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:port uuid="f5491150-b755-4504-b002-f9739aa210df">
Nov 15 23:16:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Nov 15 23:16:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:port uuid="c14ea8b5-3068-477f-9885-4fdee03d5700">
Nov 15 23:16:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.126" ipVersion="4"/>
Nov 15 23:16:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:port uuid="181986eb-bb11-4ed8-8caf-547adf633b2a">
Nov 15 23:16:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Nov 15 23:16:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:port uuid="23884449-954b-4c2e-b9e0-7daa8f4936e4">
Nov 15 23:16:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.1.1.164" ipVersion="4"/>
Nov 15 23:16:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:port uuid="0303a44c-9762-420c-bd6b-d9cacd015e7f">
Nov 15 23:16:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 23:16:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:39 user nova-compute[76391]:         <nova:port uuid="79a4bdd9-1447-478f-8f4e-db233b27e8bf">
Nov 15 23:16:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 23:16:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:39 user nova-compute[76391]:       </nova:ports>
Nov 15 23:16:39 user nova-compute[76391]:     </nova:instance>
Nov 15 23:16:39 user nova-compute[76391]:   </metadata>
Nov 15 23:16:39 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:16:39 user nova-compute[76391]:     <system>
Nov 15 23:16:39 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:16:39 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:16:39 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:16:39 user nova-compute[76391]:       <entry name="serial">737991f4-b661-45db-84ba-53dbb2dce7dc</entry>
Nov 15 23:16:39 user nova-compute[76391]:       <entry name="uuid">737991f4-b661-45db-84ba-53dbb2dce7dc</entry>
Nov 15 23:16:39 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:16:39 user nova-compute[76391]:     </system>
Nov 15 23:16:39 user nova-compute[76391]:   </sysinfo>
Nov 15 23:16:39 user nova-compute[76391]:   <os>
Nov 15 23:16:39 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:16:39 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:16:39 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:16:39 user nova-compute[76391]:   </os>
Nov 15 23:16:39 user nova-compute[76391]:   <features>
Nov 15 23:16:39 user nova-compute[76391]:     <acpi/>
Nov 15 23:16:39 user nova-compute[76391]:     <apic/>
Nov 15 23:16:39 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:16:39 user nova-compute[76391]:   </features>
Nov 15 23:16:39 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:16:39 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:16:39 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:16:39 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:16:39 user nova-compute[76391]:   </clock>
Nov 15 23:16:39 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:16:39 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:16:39 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:16:39 user nova-compute[76391]:   </cpu>
Nov 15 23:16:39 user nova-compute[76391]:   <devices>
Nov 15 23:16:39 user nova-compute[76391]:     <disk type="file" device="cdrom">
Nov 15 23:16:39 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 23:16:39 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc/disk.config"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="hda" bus="ide"/>
Nov 15 23:16:39 user nova-compute[76391]:     </disk>
Nov 15 23:16:39 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:16:39 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:16:39 user nova-compute[76391]:       <source dev="/dev/sdd"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <serial>b9a4f449-2580-4ec9-a586-48f4f6afbe66</serial>
Nov 15 23:16:39 user nova-compute[76391]:     </disk>
Nov 15 23:16:39 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:16:39 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:16:39 user nova-compute[76391]:       <source dev="/dev/sdf"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <serial>26c74feb-a2d8-47af-82d6-4dfe4f5fe075</serial>
Nov 15 23:16:39 user nova-compute[76391]:     </disk>
Nov 15 23:16:39 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:16:39 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:16:39 user nova-compute[76391]:       <source dev="/dev/sdh"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="vdc" bus="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <serial>36f873ae-23d9-4b7a-ba99-606763b5a9a9</serial>
Nov 15 23:16:39 user nova-compute[76391]:     </disk>
Nov 15 23:16:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:39 user nova-compute[76391]:       <mac address="fa:16:3e:11:c9:b7"/>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="tape8af13a5-65"/>
Nov 15 23:16:39 user nova-compute[76391]:     </interface>
Nov 15 23:16:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:39 user nova-compute[76391]:       <mac address="fa:16:3e:d3:d3:86"/>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="tapf5491150-b7"/>
Nov 15 23:16:39 user nova-compute[76391]:     </interface>
Nov 15 23:16:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:39 user nova-compute[76391]:       <mac address="fa:16:3e:73:ac:26"/>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="tapc14ea8b5-30"/>
Nov 15 23:16:39 user nova-compute[76391]:     </interface>
Nov 15 23:16:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:39 user nova-compute[76391]:       <mac address="fa:16:3e:49:e9:ed"/>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="tap181986eb-bb"/>
Nov 15 23:16:39 user nova-compute[76391]:     </interface>
Nov 15 23:16:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:39 user nova-compute[76391]:       <mac address="fa:16:3e:99:9e:aa"/>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="tap23884449-95"/>
Nov 15 23:16:39 user nova-compute[76391]:     </interface>
Nov 15 23:16:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:39 user nova-compute[76391]:       <mac address="fa:16:3e:26:b1:11"/>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="tap0303a44c-97"/>
Nov 15 23:16:39 user nova-compute[76391]:     </interface>
Nov 15 23:16:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:39 user nova-compute[76391]:       <mac address="fa:16:3e:b3:cc:69"/>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:39 user nova-compute[76391]:       <target dev="tap79a4bdd9-14"/>
Nov 15 23:16:39 user nova-compute[76391]:     </interface>
Nov 15 23:16:39 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:16:39 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc/console.log" append="off"/>
Nov 15 23:16:39 user nova-compute[76391]:     </serial>
Nov 15 23:16:39 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:16:39 user nova-compute[76391]:     <video>
Nov 15 23:16:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:39 user nova-compute[76391]:     </video>
Nov 15 23:16:39 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:16:39 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:16:39 user nova-compute[76391]:     </rng>
Nov 15 23:16:39 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:16:39 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:16:39 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:16:39 user nova-compute[76391]:     </memballoon>
Nov 15 23:16:39 user nova-compute[76391]:   </devices>
Nov 15 23:16:39 user nova-compute[76391]: </domain>
Nov 15 23:16:39 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307,network=Network(d0fe1186-1629-4bc6-bc4f-fd520d149fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8af13a5-65') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307,network=Network(d0fe1186-1629-4bc6-bc4f-fd520d149fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8af13a5-65') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dd70a9b-d452-5fa2-a564-5c1277a446ef', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8af13a5-65, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8af13a5-65, col_values=(('qos', UUID('f4532d16-250c-4900-b9fd-c08692146a9e')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8af13a5-65, col_values=(('external_ids', {'iface-id': 'e8af13a5-65d2-4d9e-bfaf-1e7c514b9307', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:c9:b7', 'vm-uuid': '737991f4-b661-45db-84ba-53dbb2dce7dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: INFO os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307,network=Network(d0fe1186-1629-4bc6-bc4f-fd520d149fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8af13a5-65')
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d3:86,bridge_name='br-int',has_traffic_filtering=True,id=f5491150-b755-4504-b002-f9739aa210df,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5491150-b7') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d3:86,bridge_name='br-int',has_traffic_filtering=True,id=f5491150-b755-4504-b002-f9739aa210df,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5491150-b7') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ba54775-a0c6-5512-83e1-69f3967401bd', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5491150-b7, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5491150-b7, col_values=(('qos', UUID('f7e3465f-c70a-497b-98d4-12b42ca68883')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5491150-b7, col_values=(('external_ids', {'iface-id': 'f5491150-b755-4504-b002-f9739aa210df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:d3:86', 'vm-uuid': '737991f4-b661-45db-84ba-53dbb2dce7dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: INFO os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d3:86,bridge_name='br-int',has_traffic_filtering=True,id=f5491150-b755-4504-b002-f9739aa210df,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5491150-b7')
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=c14ea8b5-3068-477f-9885-4fdee03d5700,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc14ea8b5-30') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=c14ea8b5-3068-477f-9885-4fdee03d5700,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc14ea8b5-30') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89dcae0c-322e-5233-a493-76d08b094ea4', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc14ea8b5-30, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc14ea8b5-30, col_values=(('qos', UUID('16fea3cf-97ec-49c6-93da-4459d3247cb7')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc14ea8b5-30, col_values=(('external_ids', {'iface-id': 'c14ea8b5-3068-477f-9885-4fdee03d5700', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:ac:26', 'vm-uuid': '737991f4-b661-45db-84ba-53dbb2dce7dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: INFO os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=c14ea8b5-3068-477f-9885-4fdee03d5700,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc14ea8b5-30')
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:e9:ed,bridge_name='br-int',has_traffic_filtering=True,id=181986eb-bb11-4ed8-8caf-547adf633b2a,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181986eb-bb') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:e9:ed,bridge_name='br-int',has_traffic_filtering=True,id=181986eb-bb11-4ed8-8caf-547adf633b2a,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181986eb-bb') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69487b58-ad3b-5b68-a54a-ae4e3c45e9d0', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap181986eb-bb, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap181986eb-bb, col_values=(('qos', UUID('63b5551a-948e-44ad-b95c-025bd0ab991a')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap181986eb-bb, col_values=(('external_ids', {'iface-id': '181986eb-bb11-4ed8-8caf-547adf633b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:e9:ed', 'vm-uuid': '737991f4-b661-45db-84ba-53dbb2dce7dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: INFO os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:e9:ed,bridge_name='br-int',has_traffic_filtering=True,id=181986eb-bb11-4ed8-8caf-547adf633b2a,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181986eb-bb')
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=23884449-954b-4c2e-b9e0-7daa8f4936e4,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23884449-95') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=23884449-954b-4c2e-b9e0-7daa8f4936e4,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23884449-95') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1545ed67-3861-5356-99ac-321cbc4b0237', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23884449-95, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23884449-95, col_values=(('qos', UUID('9275aea8-3bb6-4387-a58b-61ce6aba28e5')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23884449-95, col_values=(('external_ids', {'iface-id': '23884449-954b-4c2e-b9e0-7daa8f4936e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:9e:aa', 'vm-uuid': '737991f4-b661-45db-84ba-53dbb2dce7dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: INFO os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=23884449-954b-4c2e-b9e0-7daa8f4936e4,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23884449-95')
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b1:11,bridge_name='br-int',has_traffic_filtering=True,id=0303a44c-9762-420c-bd6b-d9cacd015e7f,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0303a44c-97') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b1:11,bridge_name='br-int',has_traffic_filtering=True,id=0303a44c-9762-420c-bd6b-d9cacd015e7f,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0303a44c-97') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88c9a933-20a8-569d-bc9c-524d92151eec', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0303a44c-97, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0303a44c-97, col_values=(('qos', UUID('0d25efa3-6d85-4736-8e28-ac5ebe4644f3')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0303a44c-97, col_values=(('external_ids', {'iface-id': '0303a44c-9762-420c-bd6b-d9cacd015e7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:b1:11', 'vm-uuid': '737991f4-b661-45db-84ba-53dbb2dce7dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-bc5e7a27-8388-4425-90bb-d6c65ee82139 req-cca0a8ed-03c9-4cfb-808f-daaf1534acf8 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bc5e7a27-8388-4425-90bb-d6c65ee82139 req-cca0a8ed-03c9-4cfb-808f-daaf1534acf8 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bc5e7a27-8388-4425-90bb-d6c65ee82139 req-cca0a8ed-03c9-4cfb-808f-daaf1534acf8 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bc5e7a27-8388-4425-90bb-d6c65ee82139 req-cca0a8ed-03c9-4cfb-808f-daaf1534acf8 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-bc5e7a27-8388-4425-90bb-d6c65ee82139 req-cca0a8ed-03c9-4cfb-808f-daaf1534acf8 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:40 user nova-compute[76391]: WARNING nova.compute.manager [req-bc5e7a27-8388-4425-90bb-d6c65ee82139 req-cca0a8ed-03c9-4cfb-808f-daaf1534acf8 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 for instance with vm_state building and task_state spawning.
Nov 15 23:16:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: INFO os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b1:11,bridge_name='br-int',has_traffic_filtering=True,id=0303a44c-9762-420c-bd6b-d9cacd015e7f,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0303a44c-97')
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=79a4bdd9-1447-478f-8f4e-db233b27e8bf,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a4bdd9-14') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=79a4bdd9-1447-478f-8f4e-db233b27e8bf,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a4bdd9-14') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d3ee9b6-b8a2-55ad-aa20-bb6661cc55dd', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79a4bdd9-14, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79a4bdd9-14, col_values=(('qos', UUID('3e42afa3-e4e9-406a-a958-189593fef1a1')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79a4bdd9-14, col_values=(('external_ids', {'iface-id': '79a4bdd9-1447-478f-8f4e-db233b27e8bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:cc:69', 'vm-uuid': '737991f4-b661-45db-84ba-53dbb2dce7dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-136023a5-cf7c-47f6-a9d0-98b91f0721ec req-654d178f-e33a-478d-b568-45a537237c9e service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-136023a5-cf7c-47f6-a9d0-98b91f0721ec req-654d178f-e33a-478d-b568-45a537237c9e service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-136023a5-cf7c-47f6-a9d0-98b91f0721ec req-654d178f-e33a-478d-b568-45a537237c9e service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-136023a5-cf7c-47f6-a9d0-98b91f0721ec req-654d178f-e33a-478d-b568-45a537237c9e service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-136023a5-cf7c-47f6-a9d0-98b91f0721ec req-654d178f-e33a-478d-b568-45a537237c9e service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:41 user nova-compute[76391]: WARNING nova.compute.manager [req-136023a5-cf7c-47f6-a9d0-98b91f0721ec req-654d178f-e33a-478d-b568-45a537237c9e service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f for instance with vm_state building and task_state spawning.
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: INFO os_vif [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=79a4bdd9-1447-478f-8f4e-db233b27e8bf,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a4bdd9-14')
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] No BDM found with device name hda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] No VIF found with MAC fa:16:3e:11:c9:b7, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] No VIF found with MAC fa:16:3e:99:9e:aa, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:16:41 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Using config drive
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:16:41 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Creating config drive at /opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc/disk.config
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3wscsi0g {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3wscsi0g" returned: 0 in 0.068s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:16:41 user nova-compute[76391]: INFO nova.compute.claims [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Claim successful on node user
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:16:42 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.policy [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65c76575aecb4eb9a883db483c842a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b51dba573d4c5ea3046cf8a8da8622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:16:42 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Creating image(s)
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "/opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "/opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:42 user nova-compute[76391]: WARNING nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 for instance with vm_state building and task_state spawning.
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:42 user nova-compute[76391]: WARNING nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 for instance with vm_state building and task_state spawning.
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:42 user nova-compute[76391]: WARNING nova.compute.manager [req-3e9b3617-7d1f-4f51-becf-ff9cab4a32f8 req-19b41b0d-4907-4ecc-91a8-ec707156b348 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 for instance with vm_state building and task_state spawning.
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk 1073741824" returned: 0 in 0.053s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Successfully created port: 2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:43 user nova-compute[76391]: WARNING nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f for instance with vm_state building and task_state spawning.
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:43 user nova-compute[76391]: WARNING nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 for instance with vm_state building and task_state spawning.
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:43 user nova-compute[76391]: WARNING nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 for instance with vm_state building and task_state spawning.
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:43 user nova-compute[76391]: WARNING nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 for instance with vm_state building and task_state spawning.
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:43 user nova-compute[76391]: WARNING nova.compute.manager [req-901e4e67-acd1-4aab-adb9-3037307a00d8 req-64eca08f-2ec5-4be1-afee-924fb9202291 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 for instance with vm_state building and task_state spawning.
Nov 15 23:16:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Cannot resize image /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Ensure instance console log exists: /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Successfully updated port: 2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquired lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Updating instance_info_cache with network_info: [{"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Releasing lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Instance network_info: |[{"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Start _get_guest_xml network_info=[{"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:16:44 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:44 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1567180745',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1567180745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1567180',id=12,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAevNfUbqTIX8ztZ2tuAO47jc7heZSRBQbVCVxVQIT5enOfOPZLlzPUYAAmF7iTPJUrWktN9Yj3oyb/bhE6GcgjoaOF1eak+rzDzeJqJCQv3KK9hklPGBFWFLmOL0sapoA==',key_name='tempest-keypair-439551556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96b51dba573d4c5ea3046cf8a8da8622',ramdisk_id='',reservation_id='r-rt7s0o0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1608108478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65c76575aecb4eb9a883db483c842a50',uuid=0e649109-ec27-45b9-93ca-ee6bddf5d0d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Converting VIF {"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=2a59c58d-9ce8-4450-9287-d8605f63d82b,network=Network(342da2a8-91f5-4e4a-8352-a67399f2ff08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a59c58d-9c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.objects.instance [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:16:44 user nova-compute[76391]:   <uuid>0e649109-ec27-45b9-93ca-ee6bddf5d0d8</uuid>
Nov 15 23:16:44 user nova-compute[76391]:   <name>instance-0000000c</name>
Nov 15 23:16:44 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:16:44 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:16:44 user nova-compute[76391]:   <metadata>
Nov 15 23:16:44 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:16:44 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:16:44 user nova-compute[76391]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1567180745</nova:name>
Nov 15 23:16:44 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:16:44</nova:creationTime>
Nov 15 23:16:44 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:16:44 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:16:44 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:16:44 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:16:44 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:16:44 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:16:44 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:16:44 user nova-compute[76391]:       <nova:owner>
Nov 15 23:16:44 user nova-compute[76391]:         <nova:user uuid="65c76575aecb4eb9a883db483c842a50">tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member</nova:user>
Nov 15 23:16:44 user nova-compute[76391]:         <nova:project uuid="96b51dba573d4c5ea3046cf8a8da8622">tempest-TestServerVolumeAttachScenarioOldVersion-1608108478</nova:project>
Nov 15 23:16:44 user nova-compute[76391]:       </nova:owner>
Nov 15 23:16:44 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:16:44 user nova-compute[76391]:       <nova:ports>
Nov 15 23:16:44 user nova-compute[76391]:         <nova:port uuid="2a59c58d-9ce8-4450-9287-d8605f63d82b">
Nov 15 23:16:44 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:16:44 user nova-compute[76391]:         </nova:port>
Nov 15 23:16:44 user nova-compute[76391]:       </nova:ports>
Nov 15 23:16:44 user nova-compute[76391]:     </nova:instance>
Nov 15 23:16:44 user nova-compute[76391]:   </metadata>
Nov 15 23:16:44 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:16:44 user nova-compute[76391]:     <system>
Nov 15 23:16:44 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:16:44 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:16:44 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:16:44 user nova-compute[76391]:       <entry name="serial">0e649109-ec27-45b9-93ca-ee6bddf5d0d8</entry>
Nov 15 23:16:44 user nova-compute[76391]:       <entry name="uuid">0e649109-ec27-45b9-93ca-ee6bddf5d0d8</entry>
Nov 15 23:16:44 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:16:44 user nova-compute[76391]:     </system>
Nov 15 23:16:44 user nova-compute[76391]:   </sysinfo>
Nov 15 23:16:44 user nova-compute[76391]:   <os>
Nov 15 23:16:44 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:16:44 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:16:44 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:16:44 user nova-compute[76391]:   </os>
Nov 15 23:16:44 user nova-compute[76391]:   <features>
Nov 15 23:16:44 user nova-compute[76391]:     <acpi/>
Nov 15 23:16:44 user nova-compute[76391]:     <apic/>
Nov 15 23:16:44 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:16:44 user nova-compute[76391]:   </features>
Nov 15 23:16:44 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:16:44 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:16:44 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:16:44 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:16:44 user nova-compute[76391]:   </clock>
Nov 15 23:16:44 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:16:44 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:16:44 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:16:44 user nova-compute[76391]:   </cpu>
Nov 15 23:16:44 user nova-compute[76391]:   <devices>
Nov 15 23:16:44 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:16:44 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:16:44 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk"/>
Nov 15 23:16:44 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:16:44 user nova-compute[76391]:     </disk>
Nov 15 23:16:44 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:16:44 user nova-compute[76391]:       <mac address="fa:16:3e:0b:a2:8e"/>
Nov 15 23:16:44 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:44 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:16:44 user nova-compute[76391]:       <target dev="tap2a59c58d-9c"/>
Nov 15 23:16:44 user nova-compute[76391]:     </interface>
Nov 15 23:16:44 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:16:44 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/console.log" append="off"/>
Nov 15 23:16:44 user nova-compute[76391]:     </serial>
Nov 15 23:16:44 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:16:44 user nova-compute[76391]:     <video>
Nov 15 23:16:44 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:16:44 user nova-compute[76391]:     </video>
Nov 15 23:16:44 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:16:44 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:16:44 user nova-compute[76391]:     </rng>
Nov 15 23:16:44 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:16:44 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:16:44 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:16:44 user nova-compute[76391]:     </memballoon>
Nov 15 23:16:44 user nova-compute[76391]:   </devices>
Nov 15 23:16:44 user nova-compute[76391]: </domain>
Nov 15 23:16:44 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1567180745',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1567180745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1567180',id=12,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAevNfUbqTIX8ztZ2tuAO47jc7heZSRBQbVCVxVQIT5enOfOPZLlzPUYAAmF7iTPJUrWktN9Yj3oyb/bhE6GcgjoaOF1eak+rzDzeJqJCQv3KK9hklPGBFWFLmOL0sapoA==',key_name='tempest-keypair-439551556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96b51dba573d4c5ea3046cf8a8da8622',ramdisk_id='',reservation_id='r-rt7s0o0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1608108478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65c76575aecb4eb9a883db483c842a50',uuid=0e649109-ec27-45b9-93ca-ee6bddf5d0d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Converting VIF {"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=2a59c58d-9ce8-4450-9287-d8605f63d82b,network=Network(342da2a8-91f5-4e4a-8352-a67399f2ff08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a59c58d-9c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG os_vif [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=2a59c58d-9ce8-4450-9287-d8605f63d82b,network=Network(342da2a8-91f5-4e4a-8352-a67399f2ff08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a59c58d-9c') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf43b09f-f6cc-5230-be47-9921aa4c43f8', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a59c58d-9c, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a59c58d-9c, col_values=(('qos', UUID('bf568e97-a87e-4b20-a71f-fe9a6890a8c4')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a59c58d-9c, col_values=(('external_ids', {'iface-id': '2a59c58d-9ce8-4450-9287-d8605f63d82b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:a2:8e', 'vm-uuid': '0e649109-ec27-45b9-93ca-ee6bddf5d0d8'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-67710f2e-7a1d-44bd-94ff-0fdf6bfc782b req-55a052a0-79ce-473f-9df5-f13e103074d6 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-67710f2e-7a1d-44bd-94ff-0fdf6bfc782b req-55a052a0-79ce-473f-9df5-f13e103074d6 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-67710f2e-7a1d-44bd-94ff-0fdf6bfc782b req-55a052a0-79ce-473f-9df5-f13e103074d6 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-67710f2e-7a1d-44bd-94ff-0fdf6bfc782b req-55a052a0-79ce-473f-9df5-f13e103074d6 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-67710f2e-7a1d-44bd-94ff-0fdf6bfc782b req-55a052a0-79ce-473f-9df5-f13e103074d6 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:44 user nova-compute[76391]: WARNING nova.compute.manager [req-67710f2e-7a1d-44bd-94ff-0fdf6bfc782b req-55a052a0-79ce-473f-9df5-f13e103074d6 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed for instance with vm_state building and task_state spawning.
Nov 15 23:16:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:44 user nova-compute[76391]: INFO os_vif [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=2a59c58d-9ce8-4450-9287-d8605f63d82b,network=Network(342da2a8-91f5-4e4a-8352-a67399f2ff08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a59c58d-9c')
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:45 user nova-compute[76391]: WARNING nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 for instance with vm_state building and task_state spawning.
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:45 user nova-compute[76391]: WARNING nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 for instance with vm_state building and task_state spawning.
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:45 user nova-compute[76391]: WARNING nova.compute.manager [req-6282a2c3-3bd3-437c-bfdb-afe661d20275 req-ae694c2a-7319-46a5-81b5-0ff51ce76bd2 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df for instance with vm_state building and task_state spawning.
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] No VIF found with MAC fa:16:3e:0b:a2:8e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-changed-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Refreshing instance network info cache due to event network-changed-2a59c58d-9ce8-4450-9287-d8605f63d82b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Acquiring lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Acquired lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Refreshing network info cache for port 2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Updated VIF entry in instance network info cache for port 2a59c58d-9ce8-4450-9287-d8605f63d82b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Updating instance_info_cache with network_info: [{"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Releasing lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:46 user nova-compute[76391]: WARNING nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 for instance with vm_state building and task_state spawning.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:46 user nova-compute[76391]: WARNING nova.compute.manager [req-83e94aa8-b552-4083-8feb-dd888e8da816 req-5927104a-8de2-4456-acbf-e30366d81689 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 for instance with vm_state building and task_state spawning.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:16:46 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance spawned successfully.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: INFO nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Took 15.17 seconds to spawn the instance on the hypervisor.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: INFO nova.compute.manager [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Took 37.99 seconds to build instance.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9de77e9a-62fc-41a2-949c-25b77de48e82 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "091f63e7-0384-434c-be37-804b10e051fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.127s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:46 user nova-compute[76391]: WARNING nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed for instance with vm_state active and task_state None.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:46 user nova-compute[76391]: WARNING nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 for instance with vm_state active and task_state None.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:46 user nova-compute[76391]: WARNING nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 for instance with vm_state active and task_state None.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:46 user nova-compute[76391]: WARNING nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 for instance with vm_state building and task_state spawning.
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:46 user nova-compute[76391]: WARNING nova.compute.manager [req-3ada37e7-1724-4483-96a9-160fb19a22cb req-0143368d-85db-459a-a469-99cf70401cbc service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:47 user nova-compute[76391]: WARNING nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:47 user nova-compute[76391]: WARNING nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:47 user nova-compute[76391]: WARNING nova.compute.manager [req-fbf72aec-bc6d-4500-baa5-fe68a280b15e req-125ca0c4-69b9-4748-8d4d-b001896f0129 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:47 user nova-compute[76391]: WARNING nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:47 user nova-compute[76391]: WARNING nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:47 user nova-compute[76391]: WARNING nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:47 user nova-compute[76391]: WARNING nova.compute.manager [req-4222fa22-93f6-443c-8847-9b94195e3198 req-f7262dd8-64d3-4e58-9890-0638eba0ead8 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf for instance with vm_state building and task_state spawning.
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:49 user nova-compute[76391]: WARNING nova.compute.manager [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received unexpected event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with vm_state building and task_state spawning.
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:16:49 user nova-compute[76391]: WARNING nova.compute.manager [req-5a90169c-00b5-42ad-9655-44094cf4324d req-dc7587fe-49af-46b0-88fd-824fdb6218df service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received unexpected event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with vm_state building and task_state spawning.
Nov 15 23:16:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:16:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Instance spawned successfully.
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:16:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance spawned successfully.
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:16:49 user nova-compute[76391]: INFO nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Took 7.17 seconds to spawn the instance on the hypervisor.
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:16:49 user nova-compute[76391]: INFO nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Took 17.34 seconds to spawn the instance on the hypervisor.
Nov 15 23:16:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:16:49 user nova-compute[76391]: INFO nova.compute.manager [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Took 8.05 seconds to build instance.
Nov 15 23:16:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c7f7b79-8135-4ee9-b6dc-21989dd5b895 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.196s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:50 user nova-compute[76391]: INFO nova.compute.manager [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Took 38.31 seconds to build instance.
Nov 15 23:16:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c54d03f-e4b5-4155-8f80-dc1277a6cc95 tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.455s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:16:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:16:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:16:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:16:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:16:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:16:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:17:10 user nova-compute[76391]: INFO nova.compute.manager [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] instance snapshotting
Nov 15 23:17:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Beginning live snapshot process
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json -f qcow2" returned: 0 in 0.389s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.226s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqzx10by_/b4be20ce5a684b9da16222913d728ce1.delta 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqzx10by_/b4be20ce5a684b9da16222913d728ce1.delta 1073741824" returned: 0 in 0.107s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 23:17:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Checking UEFI support for host arch (x86_64) {{(pid=76391) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 23:17:11 user nova-compute[76391]: INFO nova.virt.libvirt.host [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] UEFI support detected
Nov 15 23:17:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:17:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 23:17:13 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:17:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqzx10by_/b4be20ce5a684b9da16222913d728ce1.delta /opt/stack/data/nova/instances/snapshots/tmpqzx10by_/b4be20ce5a684b9da16222913d728ce1 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-changed-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Refreshing instance network info cache due to event network-changed-a0e36bda-f671-4e95-8488-e500b017cbb4. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] Acquiring lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] Acquired lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG nova.network.neutron [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Refreshing network info cache for port a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqzx10by_/b4be20ce5a684b9da16222913d728ce1.delta /opt/stack/data/nova/instances/snapshots/tmpqzx10by_/b4be20ce5a684b9da16222913d728ce1" returned: 0 in 0.695s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Snapshot extracted, beginning image upload
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG nova.network.neutron [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updated VIF entry in instance network info cache for port a0e36bda-f671-4e95-8488-e500b017cbb4. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG nova.network.neutron [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f7a3da49-127d-466c-820f-ce832b7dba17 req-b821e8e1-2a7c-4c93-b89a-68966788d899 service nova] Releasing lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Snapshot image upload complete
Nov 15 23:17:16 user nova-compute[76391]: INFO nova.compute.manager [None req-074fd86a-e0b6-44c1-9c0b-f54273230e1f tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Took 6.10 seconds to snapshot the instance on the hypervisor.
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:17:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6561MB free_disk=25.42000961303711GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance eba711fe-61e2-4fc1-97cd-1b7322c95173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance eb286b41-55ed-4a38-8e66-6edb5f0ccd0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a928dcdd-b214-4e5f-84e5-76633d313e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 2d140776-ced1-4f7a-8a28-ecc55d6a408b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 091f63e7-0384-434c-be37-804b10e051fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 737991f4-b661-45db-84ba-53dbb2dce7dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:17:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:17:19 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:17:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:17:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:17:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:17:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-changed-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Refreshing instance network info cache due to event network-changed-5abf29b6-5d3c-44e5-963f-5152c4ef6b23. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] Acquiring lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] Acquired lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Refreshing network info cache for port 5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updated VIF entry in instance network info cache for port 5abf29b6-5d3c-44e5-963f-5152c4ef6b23. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updating instance_info_cache with network_info: [{"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2e182568-059e-4561-ab03-345f6601cde5 req-70ded462-c97b-47b9-a119-7ff581ff2e00 service nova] Releasing lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG nova.objects.instance [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lazy-loading 'flavor' on Instance uuid 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:31 user nova-compute[76391]: INFO nova.compute.manager [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Attaching volume bc55b68f-e115-4a54-8767-d119cb3aa04c to /dev/vdb
Nov 15 23:17:31 user nova-compute[76391]: DEBUG os_brick.utils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[503bfe4f-ae40-44c1-a07d-ac04adf4a909]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.039s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[354cedc5-cfdd-49e7-bdf2-2540d354e0ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[589c7788-2328-41a6-9752-15bfad6d9e55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda28ee7-5e59-4b75-a7f2-4f1af12354e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:31 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:17:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa69594-3649-4a25-b4b5-d98edf267407]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG os_brick.utils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:31 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updating existing volume attachment record: b50828b6-262c-4fa4-aeab-68e4e7ecfdea {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-changed-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Refreshing instance network info cache due to event network-changed-5fadf7b5-53ec-43d7-9da2-4c09ee12427f. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] Acquiring lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] Acquired lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Refreshing network info cache for port 5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lazy-loading 'flavor' on Instance uuid cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Updated VIF entry in instance network info cache for port 5fadf7b5-53ec-43d7-9da2-4c09ee12427f. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Updating instance_info_cache with network_info: [{"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:34 user nova-compute[76391]: INFO nova.compute.manager [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Attaching volume a7bf07ba-d34e-4abd-a7b4-11f316a99669 to /dev/vdb
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1498adbe-8b2b-4785-86b0-a76e62ded5eb req-af0aa33e-376a-42df-83c8-6b264368e5c4 service nova] Releasing lock "refresh_cache-cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG os_brick.utils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad43b27c-1376-44a1-86c7-e6a45ceedf52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5319711-0892-4ab6-981d-15700b943f20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d57603-3c29-406a-9f30-bdeff72959ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c3680-7d23-4ccb-aa5c-f8e618974da6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:17:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-changed-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Refreshing instance network info cache due to event network-changed-81efae21-a14a-4c0e-8624-29fe2977d41d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] Acquiring lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] Acquired lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Refreshing network info cache for port 81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:35 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:17:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8dd0a2-5c43-4a3a-9a10-2f87d68482e4]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG os_brick.utils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Updating existing volume attachment record: 3dafacbf-1212-4d40-a781-b35d89224976 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Updated VIF entry in instance network info cache for port 81efae21-a14a-4c0e-8624-29fe2977d41d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Updating instance_info_cache with network_info: [{"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ce87f44d-7922-4ebe-9b56-9a6dddcb0009 req-41d6b125-68c6-45b2-9366-b8d1552b6ef3 service nova] Releasing lock "refresh_cache-eba711fe-61e2-4fc1-97cd-1b7322c95173" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lazy-loading 'flavor' on Instance uuid eba711fe-61e2-4fc1-97cd-1b7322c95173 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmCPTZiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:36 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260" returned: 21 in 0.051s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d2dbed-1b1b-4de2-b463-fae46f636849]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:17:36 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b23b92-cbcc-4b1c-8317-417e7a86ada4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c] added
Nov 15 23:17:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10443de2-a965-4a0b-b8d0-0c831c0f4151]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-changed-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Refreshing instance network info cache due to event network-changed-b09aad63-4edf-494c-808a-4b0472dfdd18. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] Acquiring lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] Acquired lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.network.neutron [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Refreshing network info cache for port b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb363f-3502-4662-8381-c216340b2978]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmCPTZiF {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmCPTZiF" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdd61dd-f8fb-49b1-9fcc-b01c37a883db]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmCPTZiF'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:37 user nova-compute[76391]: INFO nova.compute.manager [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Attaching volume 0efeee2f-5814-4e9e-baa3-920190cbc734 to /dev/sdc
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5392768a-0ecf-4978-a0e8-f9e95c9fbf9e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: INFO nova.compute.manager [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Rebuilding instance
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.utils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43f6f0-100a-4b49-87b3-24948d00f772]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bbe26b-5eeb-42ed-aa5a-68d2df4f3a71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0928212-796a-4e73-8381-2551b7e0535b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec379878-386a-4db7-a834-5fc1a021193b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9baf6ca-20d6-47ea-a3e1-564e8f3d8d21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --login" returned: 0 in 0.131s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaa6854-55bc-44a2-acd0-8720a674e201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260]
Nov 15 23:17:37 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260] successful.
Nov 15 23:17:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:37 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15212f4-211d-4994-aede-1a1a44cb0e70]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.utils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Updating existing volume attachment record: b93783b6-5055-46b4-aea6-2c6bc46557be {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ca266-9953-48fc-8bd1-50cdc8961532]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d5403b-0a4a-4568-9079-89d5e329b193]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:37 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.491s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad702f-f9f2-4e40-9e75-95f46409b536]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmCPTZiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.network.neutron [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updated VIF entry in instance network info cache for port b09aad63-4edf-494c-808a-4b0472dfdd18. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.network.neutron [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updating instance_info_cache with network_info: [{"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4477c4ec-7021-47ee-b1f9-4d2f77695f5f req-af0594c9-fa79-4ee0-8191-60d9eb5e5afe service nova] Releasing lock "refresh_cache-eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-3bbe4117-df8a-4f5f-bbcb-af6c3a70f351 req-1c13f078-5761-4fca-bde7-c7cf0d94a53b service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-unplugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3bbe4117-df8a-4f5f-bbcb-af6c3a70f351 req-1c13f078-5761-4fca-bde7-c7cf0d94a53b service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3bbe4117-df8a-4f5f-bbcb-af6c3a70f351 req-1c13f078-5761-4fca-bde7-c7cf0d94a53b service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3bbe4117-df8a-4f5f-bbcb-af6c3a70f351 req-1c13f078-5761-4fca-bde7-c7cf0d94a53b service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-3bbe4117-df8a-4f5f-bbcb-af6c3a70f351 req-1c13f078-5761-4fca-bde7-c7cf0d94a53b service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-unplugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:17:37 user nova-compute[76391]: WARNING nova.compute.manager [req-3bbe4117-df8a-4f5f-bbcb-af6c3a70f351 req-1c13f078-5761-4fca-bde7-c7cf0d94a53b service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received unexpected event network-vif-unplugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with vm_state active and task_state rebuilding.
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "interface-a928dcdd-b214-4e5f-84e5-76633d313e4b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "interface-a928dcdd-b214-4e5f-84e5-76633d313e4b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'flavor' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance destroyed successfully.
Nov 15 23:17:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance destroyed successfully.
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1817328166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1185346505',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgS5owXYTIhp2CyONYKVA6cDqle9QogIygYExxZVew6Eyp+xF5P9KjoNDuUWixbTD8FG5eY4YFl/RQGWgxPOIDDfU+kWnosaJaWDfsFFB/PSD6XOidlEmphF4w4bqLdug==',key_name='tempest-keypair-2000121693',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99cf3b6665eb46cf93ec4b66f688dfe4',ramdisk_id='',reservation_id='r-s984ualt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1456826566',owner_user_name='tempest-ServerActionsV293TestJSON-1456826566-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec4681c47a4458888403c64e96f59d2',uuid=eb286b41-55ed-4a38-8e66-6edb5f0ccd0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converting VIF {"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_vif [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb09aad63-4e, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cff0924b-741b-4888-a618-f8db764b786d) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:17:38 user nova-compute[76391]: INFO os_vif [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e')
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:38 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'pci_requests' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.objects.base [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Object Instance<a928dcdd-b214-4e5f-84e5-76633d313e4b> lazy-loaded attributes: flavor,pci_requests {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.policy [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '538446003d4147a586ba8675a3fbef81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14a7df237f84c518de0804a57254975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.557s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] <== connect_volume: return (1559ms) {'type': 'block', 'scsi_wwn': '26561303737643336', 'path': '/dev/sdi'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561303737643336', 'path': '/dev/sdi'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.225s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lazy-loading 'flavor' on Instance uuid 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193a711-f50d-4946-8007-d638fe875247]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:17:38 user nova-compute[76391]: No targets found.
Nov 15 23:17:38 user nova-compute[76391]: iSNS:
Nov 15 23:17:38 user nova-compute[76391]: No targets found.
Nov 15 23:17:38 user nova-compute[76391]: STATIC:
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:17:38 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:38 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:38 user nova-compute[76391]: FIRMWARE:
Nov 15 23:17:38 user nova-compute[76391]: No targets found.
Nov 15 23:17:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:17:38 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:17:38 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f00461-aadd-47a0-a797-7391e3afe77c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:17:38 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:38 user nova-compute[76391]:   <source dev="/dev/sdi"/>
Nov 15 23:17:38 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:17:38 user nova-compute[76391]:   <serial>bc55b68f-e115-4a54-8767-d119cb3aa04c</serial>
Nov 15 23:17:38 user nova-compute[76391]: </disk>
Nov 15 23:17:38 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13313231-27bd-4065-a0f7-094566d720ef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:38 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97603896c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4e84c5-13b5-48cb-8324-4725c5ad2a6a]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98d6e8c-cfa9-4619-9eae-f965ee247046]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b09539-1fa7-4873-ac47-3e0cba347ef8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5059b3-dfa8-45b7-8383-2c99416f8594]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd73d6b-6cd9-402d-8baa-cfba8780a18a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38b193a-3ce7-4287-8df1-657e0fea7faf]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]
Nov 15 23:17:38 user nova-compute[76391]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.
Nov 15 23:17:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb9e438-113f-401d-9856-fb676aafd0fc]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] <== disconnect_volume: return (618ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:17:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Deleting instance files /opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e_del
Nov 15 23:17:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Deletion of /opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e_del complete
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Successfully created port: 1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] No VIF found with MAC fa:16:3e:dd:1d:59, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-changed-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Refreshing instance network info cache due to event network-changed-9722bca6-f5a9-46c2-81ab-f50b88433b28. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] Acquiring lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] Acquired lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Refreshing network info cache for port 9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance eb286b41-55ed-4a38-8e66-6edb5f0ccd0e could not be found.
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:39 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cf49d3-483c-4abb-9278-bc361d19349a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:17:39 user nova-compute[76391]: No targets found.
Nov 15 23:17:39 user nova-compute[76391]: iSNS:
Nov 15 23:17:39 user nova-compute[76391]: No targets found.
Nov 15 23:17:39 user nova-compute[76391]: STATIC:
Nov 15 23:17:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95
Nov 15 23:17:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1
Nov 15 23:17:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162
Nov 15 23:17:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:17:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:17:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c
Nov 15 23:17:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:17:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:39 user nova-compute[76391]: FIRMWARE:
Nov 15 23:17:39 user nova-compute[76391]: No targets found.
Nov 15 23:17:39 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:17:39 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:17:39 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-69b18805-1338-4687-b4e5-a6c8e38aad1f tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.694s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e185751d-e50f-44e4-b96a-056cfd9a1674]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395f9c4-07dd-4fd7-849e-a43423180d84]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:39 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:39 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:39 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976038b6d0>, {}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Disconnecting from: [] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] <== disconnect_volume: return (93ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-6a7d3e4d-3606-4416-b41f-0ea451d406d0 req-de5d1f2d-9ed0-49af-9030-160c8e70b49f service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6a7d3e4d-3606-4416-b41f-0ea451d406d0 req-de5d1f2d-9ed0-49af-9030-160c8e70b49f service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6a7d3e4d-3606-4416-b41f-0ea451d406d0 req-de5d1f2d-9ed0-49af-9030-160c8e70b49f service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6a7d3e4d-3606-4416-b41f-0ea451d406d0 req-de5d1f2d-9ed0-49af-9030-160c8e70b49f service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-6a7d3e4d-3606-4416-b41f-0ea451d406d0 req-de5d1f2d-9ed0-49af-9030-160c8e70b49f service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:17:39 user nova-compute[76391]: WARNING nova.compute.manager [req-6a7d3e4d-3606-4416-b41f-0ea451d406d0 req-de5d1f2d-9ed0-49af-9030-160c8e70b49f service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received unexpected event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with vm_state active and task_state rebuilding.
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updated VIF entry in instance network info cache for port 9722bca6-f5a9-46c2-81ab-f50b88433b28. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating instance_info_cache with network_info: [{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Successfully updated port: 1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-61d1d217-e8e5-445d-862a-97d758367e3a req-ca867945-301d-4829-9731-3aa69000f961 service nova] Releasing lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquired lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-changed-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Refreshing instance network info cache due to event network-changed-1cfba799-5f77-44cb-a9b5-86902b7456e4. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] Acquiring lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Preparing to wait for external event volume-reimaged-fba4cc50-1dea-41a7-93f3-7c414425be67 {{(pid=76391) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating instance_info_cache with network_info: [{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Releasing lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] Acquired lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.network.neutron [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Refreshing network info cache for port 1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392690336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392690336',id=7,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0IspOOwh4AxJxavAWXMIXxyzIMrl5nEywXM3UCkaIXrQ4id+z3X0cGmiwOi/O0sqc9uZ5aEcv3TENtVTyqVPRYbiCBkzRNPUHJ+VUjOn4PSSiaFmNQVRgZ33uNsYuXlQ==',key_name='tempest-keypair-210828776',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14a7df237f84c518de0804a57254975',ramdisk_id='',reservation_id='r-kti4w7p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986589477',owner_user_name='tempest-TaggedAttachmentsTest-1986589477-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538446003d4147a586ba8675a3fbef81',uuid=a928dcdd-b214-4e5f-84e5-76633d313e4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converting VIF {"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_vif [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05c1bf38-7f96-5f90-aafd-781d045b54c0', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cfba799-5f, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cfba799-5f, col_values=(('qos', UUID('2f937977-9682-4494-9252-4f955506e5ca')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cfba799-5f, col_values=(('external_ids', {'iface-id': '1cfba799-5f77-44cb-a9b5-86902b7456e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:86:34', 'vm-uuid': 'a928dcdd-b214-4e5f-84e5-76633d313e4b'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: INFO os_vif [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f')
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392690336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392690336',id=7,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0IspOOwh4AxJxavAWXMIXxyzIMrl5nEywXM3UCkaIXrQ4id+z3X0cGmiwOi/O0sqc9uZ5aEcv3TENtVTyqVPRYbiCBkzRNPUHJ+VUjOn4PSSiaFmNQVRgZ33uNsYuXlQ==',key_name='tempest-keypair-210828776',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14a7df237f84c518de0804a57254975',ramdisk_id='',reservation_id='r-kti4w7p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986589477',owner_user_name='tempest-TaggedAttachmentsTest-1986589477-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538446003d4147a586ba8675a3fbef81',uuid=a928dcdd-b214-4e5f-84e5-76633d313e4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converting VIF {"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] attach device xml: <interface type="ethernet">
Nov 15 23:17:40 user nova-compute[76391]:   <mac address="fa:16:3e:e1:86:34"/>
Nov 15 23:17:40 user nova-compute[76391]:   <model type="virtio"/>
Nov 15 23:17:40 user nova-compute[76391]:   <mtu size="1442"/>
Nov 15 23:17:40 user nova-compute[76391]:   <target dev="tap1cfba799-5f"/>
Nov 15 23:17:40 user nova-compute[76391]: </interface>
Nov 15 23:17:40 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:40 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:40 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:40 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefe616d-77de-4e15-b3e8-ad7872c4a45f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:17:40 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:40 user nova-compute[76391]: INFO nova.compute.manager [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Detaching volume bc55b68f-e115-4a54-8767-d119cb3aa04c
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccf7c68-9f14-4850-8fc5-a755c373be13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669] added
Nov 15 23:17:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d2be2f-8801-4dc9-981f-42421665d0b7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:40 user nova-compute[76391]: INFO nova.virt.block_device [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Attempting to driver detach volume bc55b68f-e115-4a54-8767-d119cb3aa04c from mountpoint /dev/vdb
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118ab8a-24c5-4223-aac8-f4a215ae8b67]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaZXSthk {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Attempting to detach device vdb from instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:17:40 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:40 user nova-compute[76391]:   <source dev="/dev/sdi"/>
Nov 15 23:17:40 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:17:40 user nova-compute[76391]:   <serial>bc55b68f-e115-4a54-8767-d119cb3aa04c</serial>
Nov 15 23:17:40 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:17:40 user nova-compute[76391]: </disk>
Nov 15 23:17:40 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaZXSthk" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c66d1bc-86b8-4398-83e3-c6f856c846ca]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WaZXSthk'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c0865c-88bc-439c-a528-354c7b6ad0dd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:40 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Successfully detached device vdb from instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee from the persistent domain config.
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:17:40 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:40 user nova-compute[76391]:   <source dev="/dev/sdi"/>
Nov 15 23:17:40 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:17:40 user nova-compute[76391]:   <serial>bc55b68f-e115-4a54-8767-d119cb3aa04c</serial>
Nov 15 23:17:40 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:17:40 user nova-compute[76391]: </disk>
Nov 15 23:17:40 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fed557-55eb-47d4-b0ab-22a1f1709e95]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:40 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cf521a-3a47-4c15-bdfa-6921666622cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]
Nov 15 23:17:41 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.
Nov 15 23:17:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e7f78-2122-4c8e-bab4-77f885c7c692]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c83172-a116-4a1b-9a85-417a0c07d306]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:41 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No BDM found with device name hda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No VIF found with MAC fa:16:3e:fb:23:fb, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.network.neutron [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updated VIF entry in instance network info cache for port 1cfba799-5f77-44cb-a9b5-86902b7456e4. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.network.neutron [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating instance_info_cache with network_info: [{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba26d9b-0cf3-42f9-b7f7-7c0ec83dd791 req-a5bcbe3a-99e0-40b6-b805-92c2d9861294 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba26d9b-0cf3-42f9-b7f7-7c0ec83dd791 req-a5bcbe3a-99e0-40b6-b805-92c2d9861294 service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba26d9b-0cf3-42f9-b7f7-7c0ec83dd791 req-a5bcbe3a-99e0-40b6-b805-92c2d9861294 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba26d9b-0cf3-42f9-b7f7-7c0ec83dd791 req-a5bcbe3a-99e0-40b6-b805-92c2d9861294 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba26d9b-0cf3-42f9-b7f7-7c0ec83dd791 req-a5bcbe3a-99e0-40b6-b805-92c2d9861294 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:17:41 user nova-compute[76391]: WARNING nova.compute.manager [req-bba26d9b-0cf3-42f9-b7f7-7c0ec83dd791 req-a5bcbe3a-99e0-40b6-b805-92c2d9861294 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received unexpected event network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 for instance with vm_state active and task_state None.
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6073d05f-c04e-4cff-8c0a-2dfdae9e9fdd]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f9782e4e-76ae-43c4-95a6-c0e6090a059f req-fc8ffe27-feff-4350-9059-cc2312a4e9ec service nova] Releasing lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:17:41 user nova-compute[76391]:   <nova:package version="0.0.0"/>
Nov 15 23:17:41 user nova-compute[76391]:   <nova:name>tempest-device-tagging-server-392690336</nova:name>
Nov 15 23:17:41 user nova-compute[76391]:   <nova:creationTime>2023-11-15 23:17:41</nova:creationTime>
Nov 15 23:17:41 user nova-compute[76391]:   <nova:flavor name="m1.tiny">
Nov 15 23:17:41 user nova-compute[76391]:     <nova:memory>512</nova:memory>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:disk>1</nova:disk>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:swap>0</nova:swap>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 23:17:41 user nova-compute[76391]:   </nova:flavor>
Nov 15 23:17:41 user nova-compute[76391]:   <nova:owner>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:user uuid="538446003d4147a586ba8675a3fbef81">tempest-TaggedAttachmentsTest-1986589477-project-member</nova:user>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:project uuid="e14a7df237f84c518de0804a57254975">tempest-TaggedAttachmentsTest-1986589477</nova:project>
Nov 15 23:17:41 user nova-compute[76391]:   </nova:owner>
Nov 15 23:17:41 user nova-compute[76391]:   <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:17:41 user nova-compute[76391]:   <nova:ports>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:port uuid="9722bca6-f5a9-46c2-81ab-f50b88433b28">
Nov 15 23:17:41 user nova-compute[76391]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:17:41 user nova-compute[76391]:     </nova:port>
Nov 15 23:17:41 user nova-compute[76391]:     <nova:port uuid="1cfba799-5f77-44cb-a9b5-86902b7456e4">
Nov 15 23:17:41 user nova-compute[76391]:       <nova:ip type="fixed" address="10.10.10.149" ipVersion="4"/>
Nov 15 23:17:41 user nova-compute[76391]:     </nova:port>
Nov 15 23:17:41 user nova-compute[76391]:   </nova:ports>
Nov 15 23:17:41 user nova-compute[76391]: </nova:instance>
Nov 15 23:17:41 user nova-compute[76391]:  {{(pid=76391) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3c6f213f-1c05-4bf1-94e9-445e806990ee tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "interface-a928dcdd-b214-4e5f-84e5-76633d313e4b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.226s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'flavor' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:41 user nova-compute[76391]: INFO nova.compute.manager [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Attaching volume 98725c2b-e8bc-4f9a-875d-73f6e6d86e41 to /dev/vdb
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.utils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba106e0-158e-4190-9fcc-cecbb2d3e6ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88159915-994b-4bb7-897f-bae60986dfa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06516f86-c3c2-4041-9d35-4835041f6836]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2b65a-27bb-4743-be6d-022c9b4a5dff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:41 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:17:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad79f42e-431d-4aaf-a3cb-9cc42cc9472a]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG os_brick.utils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:41 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating existing volume attachment record: 1640f6ed-a63e-450c-9868-fceb56902be3 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '23064303964663831', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064303964663831', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lazy-loading 'flavor' on Instance uuid cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:17:42 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:42 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:17:42 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:17:42 user nova-compute[76391]:   <serial>a7bf07ba-d34e-4abd-a7b4-11f316a99669</serial>
Nov 15 23:17:42 user nova-compute[76391]: </disk>
Nov 15 23:17:42 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] No VIF found with MAC fa:16:3e:99:29:30, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zQPdvbxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:42 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:42 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:42 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[231e4728-3dfb-48db-8958-02bcd6e085e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:17:42 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7087cd5-3981-4136-bebc-9e5bd28f2457]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734] added
Nov 15 23:17:42 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66617994-ea23-4ca9-96a7-0875636e78cd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d94d7-a043-4ada-9dcd-302b73f85849]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zQPdvbxm {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e49ed22d-807a-40a7-a92a-aefd4caebf5a tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.047s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zQPdvbxm" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e45035-6160-41c4-be88-b58b003e757a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zQPdvbxm'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790bc19-c45d-4243-8d48-75288c735ce4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1bea9-b46e-42f8-ae53-6c411787e726]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:42 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:42 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:42 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[976a9ef5-3c26-4a98-a3cd-aa6088e1f349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260]
Nov 15 23:17:43 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260] successful.
Nov 15 23:17:43 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e6aac-1da1-4c61-ada2-b6b400630a92]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ed586b-f947-4a65-9196-c932037dd221]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:43 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:43 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:43 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a224f-dc38-4897-ab07-c72fef2ec101]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zQPdvbxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-628dfbb6-b981-428d-bbdd-dbe50c5bf8c8 req-db4a57aa-0fd3-4d1b-92ff-3ba1616b0dc0 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-628dfbb6-b981-428d-bbdd-dbe50c5bf8c8 req-db4a57aa-0fd3-4d1b-92ff-3ba1616b0dc0 service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-628dfbb6-b981-428d-bbdd-dbe50c5bf8c8 req-db4a57aa-0fd3-4d1b-92ff-3ba1616b0dc0 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-628dfbb6-b981-428d-bbdd-dbe50c5bf8c8 req-db4a57aa-0fd3-4d1b-92ff-3ba1616b0dc0 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-628dfbb6-b981-428d-bbdd-dbe50c5bf8c8 req-db4a57aa-0fd3-4d1b-92ff-3ba1616b0dc0 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:17:43 user nova-compute[76391]: WARNING nova.compute.manager [req-628dfbb6-b981-428d-bbdd-dbe50c5bf8c8 req-db4a57aa-0fd3-4d1b-92ff-3ba1616b0dc0 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received unexpected event network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 for instance with vm_state active and task_state None.
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:43 user nova-compute[76391]: INFO nova.compute.manager [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Terminating instance
Nov 15 23:17:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Instance destroyed successfully.
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.objects.instance [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lazy-loading 'resources' on Instance uuid 2d140776-ced1-4f7a-8a28-ecc55d6a408b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1408701417',display_name='tempest-VolumesActionsTest-instance-1408701417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1408701417',id=8,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5841417a1d4439c8059c788533b08b9',ramdisk_id='',reservation_id='r-nn060bhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1618594309',owner_user_name='tempest-VolumesActionsTest-1618594309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:03Z,user_data=None,user_id='2af794740660401081cf6d7e38289bd0',uuid=2d140776-ced1-4f7a-8a28-ecc55d6a408b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converting VIF {"id": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "address": "fa:16:3e:3a:a0:5e", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc5327f-7a", "ovs_interfaceid": "1bc5327f-7aa5-4508-9165-29cc94dd906a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=1bc5327f-7aa5-4508-9165-29cc94dd906a,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5327f-7a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_vif [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=1bc5327f-7aa5-4508-9165-29cc94dd906a,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5327f-7a') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bc5327f-7a, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f13e199d-ff3d-48ae-b8fd-6cb0de006865) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:44 user nova-compute[76391]: INFO os_vif [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=1bc5327f-7aa5-4508-9165-29cc94dd906a,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc5327f-7a')
Nov 15 23:17:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Deleting instance files /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b_del
Nov 15 23:17:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Deletion of /opt/stack/data/nova/instances/2d140776-ced1-4f7a-8a28-ecc55d6a408b_del complete
Nov 15 23:17:44 user nova-compute[76391]: INFO nova.compute.manager [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23662616465666661', 'path': '/dev/sdj'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662616465666661', 'path': '/dev/sdj'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lazy-loading 'flavor' on Instance uuid eba711fe-61e2-4fc1-97cd-1b7322c95173 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:17:44 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:44 user nova-compute[76391]:   <source dev="/dev/sdj"/>
Nov 15 23:17:44 user nova-compute[76391]:   <target dev="sdc" bus="scsi"/>
Nov 15 23:17:44 user nova-compute[76391]:   <serial>0efeee2f-5814-4e9e-baa3-920190cbc734</serial>
Nov 15 23:17:44 user nova-compute[76391]:   <address type="drive" controller="0" unit="2"/>
Nov 15 23:17:44 user nova-compute[76391]: </disk>
Nov 15 23:17:44 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.utils [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9482bb3-9603-47e8-a3ae-91b7e90de39e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee06815-526a-4f34-b9f0-c078f6e64bcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9496ef17-9887-4b39-a849-f9b054fe8a04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76344ec4-8251-4b66-a5d6-fd22615654d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:44 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[602fa88c-61e1-4aa5-a23c-350644fb0e63]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG os_brick.utils [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:44 user nova-compute[76391]: INFO nova.compute.manager [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Swapping volume a7bf07ba-d34e-4abd-a7b4-11f316a99669 for a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:17:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] No BDM found with device name sda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] No BDM found with device name sdc, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] No VIF found with MAC fa:16:3e:03:da:bd, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:17:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9e827f67-a5f0-49f6-9850-40a6f8981a42 tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.770s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:45 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Took 0.90 seconds to deallocate network for instance.
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-78d4ba0a-4d17-4dc7-a670-93579bd2227b req-c832225d-8b7f-4f63-9278-72ee6512e4de service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received event network-vif-deleted-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:45 user nova-compute[76391]: INFO nova.compute.manager [req-78d4ba0a-4d17-4dc7-a670-93579bd2227b req-c832225d-8b7f-4f63-9278-72ee6512e4de service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Neutron deleted interface 1bc5327f-7aa5-4508-9165-29cc94dd906a; detaching it from the instance and deleting it from the info cache
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-78d4ba0a-4d17-4dc7-a670-93579bd2227b req-c832225d-8b7f-4f63-9278-72ee6512e4de service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-78d4ba0a-4d17-4dc7-a670-93579bd2227b req-c832225d-8b7f-4f63-9278-72ee6512e4de service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Detach interface failed, port_id=1bc5327f-7aa5-4508-9165-29cc94dd906a, reason: Instance 2d140776-ced1-4f7a-8a28-ecc55d6a408b could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received event network-vif-unplugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] Acquiring lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] No waiting events found dispatching network-vif-unplugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:17:45 user nova-compute[76391]: WARNING nova.compute.manager [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received unexpected event network-vif-unplugged-1bc5327f-7aa5-4508-9165-29cc94dd906a for instance with vm_state deleted and task_state None.
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received event network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] Acquiring lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] No waiting events found dispatching network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:17:45 user nova-compute[76391]: WARNING nova.compute.manager [req-fed4140e-36c3-4f78-808e-54db2b77fcff req-b4071800-e3cc-4e82-ab8c-598113b4421d service nova] [instance: 2d140776-ced1-4f7a-8a28-ecc55d6a408b] Received unexpected event network-vif-plugged-1bc5327f-7aa5-4508-9165-29cc94dd906a for instance with vm_state deleted and task_state None.
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:45 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Deleted allocations for instance 2d140776-ced1-4f7a-8a28-ecc55d6a408b
Nov 15 23:17:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95813b63-8310-4fa7-a559-657b9e466bb0 tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "2d140776-ced1-4f7a-8a28-ecc55d6a408b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:46 user nova-compute[76391]: INFO nova.compute.manager [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Detaching volume 0efeee2f-5814-4e9e-baa3-920190cbc734
Nov 15 23:17:46 user nova-compute[76391]: INFO nova.virt.block_device [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Attempting to driver detach volume 0efeee2f-5814-4e9e-baa3-920190cbc734 from mountpoint /dev/sdc
Nov 15 23:17:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Attempting to detach device sdc from instance eba711fe-61e2-4fc1-97cd-1b7322c95173 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:17:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:17:46 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:46 user nova-compute[76391]:   <source dev="/dev/sdj"/>
Nov 15 23:17:46 user nova-compute[76391]:   <target dev="sdc" bus="scsi"/>
Nov 15 23:17:46 user nova-compute[76391]:   <serial>0efeee2f-5814-4e9e-baa3-920190cbc734</serial>
Nov 15 23:17:46 user nova-compute[76391]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 23:17:46 user nova-compute[76391]: </disk>
Nov 15 23:17:46 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:17:46 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Successfully detached device sdc from instance eba711fe-61e2-4fc1-97cd-1b7322c95173 from the persistent domain config.
Nov 15 23:17:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance eba711fe-61e2-4fc1-97cd-1b7322c95173 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:17:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:17:46 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:46 user nova-compute[76391]:   <source dev="/dev/sdj"/>
Nov 15 23:17:46 user nova-compute[76391]:   <target dev="sdc" bus="scsi"/>
Nov 15 23:17:46 user nova-compute[76391]:   <serial>0efeee2f-5814-4e9e-baa3-920190cbc734</serial>
Nov 15 23:17:46 user nova-compute[76391]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 23:17:46 user nova-compute[76391]: </disk>
Nov 15 23:17:46 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:17:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance eba711fe-61e2-4fc1-97cd-1b7322c95173 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbpFEPSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:47 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:47 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:47 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e09b337-2a16-456f-a69f-0c46c99486b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:17:47 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c12281-e528-4d7d-a72c-6d269e4b03a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41] added
Nov 15 23:17:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.160s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a31aee-7494-4336-b8dc-ce21befdf645]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad1242-d047-46e5-9dcd-ef88143244c2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbpFEPSx {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbpFEPSx" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f9cf47-40a8-4ec9-833a-cc26d1872116]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XbpFEPSx'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06208934-927b-4595-8649-8e23951f5ad7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6c2754-c219-4ce6-97ab-b0af8d652bc5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa5d53-b6e2-47ba-8bf0-7f662aca810d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260]
Nov 15 23:17:47 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260] successful.
Nov 15 23:17:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[613c41e3-e0a0-4e69-9d5c-5a67abe6fe00]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78248e63-4399-472c-8243-b462f0b1fce8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:47 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.506s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:17:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51559b22-8fd9-4ba4-b8c3-65e89004b6e5]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbpFEPSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] <== connect_volume: return (1538ms) {'type': 'block', 'scsi_wwn': '23038353963356234', 'path': '/dev/sdl'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038353963356234', 'path': '/dev/sdl'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'flavor' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:17:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:49 user nova-compute[76391]:   <source dev="/dev/sdl"/>
Nov 15 23:17:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:17:49 user nova-compute[76391]:   <serial>98725c2b-e8bc-4f9a-875d-73f6e6d86e41</serial>
Nov 15 23:17:49 user nova-compute[76391]: </disk>
Nov 15 23:17:49 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No BDM found with device name hda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] No VIF found with MAC fa:16:3e:fb:23:fb, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ba66e8ec-ad14-4ee6-8bbe-0a2ee4aa3175 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.829s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVUoZym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cfe1ee59-af8a-479e-a77d-1c7af3ba30fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'serial': 'a0e0a774-e0b3-40f1-a288-2212ddda86d6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'cfe1ee59-af8a-479e-a77d-1c7af3ba30fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'serial'} {{(pid=76391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVUoZym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:50 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:50 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:50 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ecae82-1068-46b3-af8c-83451076cb39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:17:50 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9215c9-bc4f-466e-958e-362e3814141e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6] added
Nov 15 23:17:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[933b1043-8c15-4e34-bea3-f9c0300f63c8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14575ea3-44a2-4d6a-bec3-a060030e17ad]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVUoZym {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVUoZym" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e2d64-2a8b-457f-9e26-fd971155d4e2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFVUoZym'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[841e6da7-2745-4f48-87b6-c7b4e3b6cc4a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[272c39aa-e8ab-4c9d-ae9e-1ccde70aad3f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86af861-d750-4072-b861-3e1b4c3db683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260]
Nov 15 23:17:50 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260] successful.
Nov 15 23:17:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f62c5e-ef91-4d76-9246-393c3e5491ed]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c353c1ee-2a30-4ff5-936e-7c50aca7d93a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:50 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86922190-0014-4724-aa78-0357a8093032]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:17:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVUoZym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:51 user nova-compute[76391]: INFO nova.compute.manager [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Detaching volume 98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:17:51 user nova-compute[76391]: INFO nova.virt.block_device [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Attempting to driver detach volume 98725c2b-e8bc-4f9a-875d-73f6e6d86e41 from mountpoint /dev/vdb
Nov 15 23:17:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Attempting to detach device vdb from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:17:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:51 user nova-compute[76391]:   <source dev="/dev/sdl"/>
Nov 15 23:17:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:17:51 user nova-compute[76391]:   <serial>98725c2b-e8bc-4f9a-875d-73f6e6d86e41</serial>
Nov 15 23:17:51 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 23:17:51 user nova-compute[76391]: </disk>
Nov 15 23:17:51 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:17:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully detached device vdb from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the persistent domain config.
Nov 15 23:17:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:17:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:17:51 user nova-compute[76391]:   <source dev="/dev/sdl"/>
Nov 15 23:17:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:17:51 user nova-compute[76391]:   <serial>98725c2b-e8bc-4f9a-875d-73f6e6d86e41</serial>
Nov 15 23:17:51 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 23:17:51 user nova-compute[76391]: </disk>
Nov 15 23:17:51 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26138633033386630', 'path': '/dev/sdm'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138633033386630', 'path': '/dev/sdm'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:17:51 user nova-compute[76391]: DEBUG nova.objects.instance [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lazy-loading 'flavor' on Instance uuid cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 22020096 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 80740352 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 138412032 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 191889408 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 332398592 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 503316480 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 646971392 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-changed-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Refreshing instance network info cache due to event network-changed-8be279d3-1083-450b-837f-9fab64339e5d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] Acquiring lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] Acquired lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG nova.network.neutron [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Refreshing network info cache for port 8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG nova.objects.instance [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lazy-loading 'flavor' on Instance uuid 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 752877568 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Updated VIF entry in instance network info cache for port 8be279d3-1083-450b-837f-9fab64339e5d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Updating instance_info_cache with network_info: [{"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8d109cff-d51b-469e-855b-17821dc37f2f req-eaf04733-5648-451d-91b2-9b42a3b30899 service nova] Releasing lock "refresh_cache-9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:57 user nova-compute[76391]: INFO nova.compute.manager [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Attaching volume fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 to /dev/vdb
Nov 15 23:17:57 user nova-compute[76391]: DEBUG os_brick.utils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[750fb683-469f-4e62-9991-e2ddd2656a19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfdc900-5abd-4f61-9872-af4673377774]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc63bfa4-3a5b-4816-9728-e7dcac110a24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[384f31de-406e-4359-838e-0797516f2492]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:57 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:17:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82aeb34-6db1-4b2e-bbb5-c22186ab5cd0]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG os_brick.utils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Updating existing volume attachment record: 2efd52bd-92a4-49c9-b8a3-9748e5b7377c {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 891289600 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 1022361600 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-8245b5e5-e11a-4291-87a8-ec232a365744 req-73d37490-528a-4598-b32d-8e2508de7ce6 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event volume-reimaged-fba4cc50-1dea-41a7-93f3-7c414425be67 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8245b5e5-e11a-4291-87a8-ec232a365744 req-73d37490-528a-4598-b32d-8e2508de7ce6 service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8245b5e5-e11a-4291-87a8-ec232a365744 req-73d37490-528a-4598-b32d-8e2508de7ce6 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8245b5e5-e11a-4291-87a8-ec232a365744 req-73d37490-528a-4598-b32d-8e2508de7ce6 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-8245b5e5-e11a-4291-87a8-ec232a365744 req-73d37490-528a-4598-b32d-8e2508de7ce6 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Processing event volume-reimaged-fba4cc50-1dea-41a7-93f3-7c414425be67 {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:17:58 user nova-compute[76391]: INFO nova.virt.block_device [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Booting with volume fba4cc50-1dea-41a7-93f3-7c414425be67 at /dev/vda
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.utils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff49c2c2-ff5d-4ad2-9eba-35162595bb1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b562e967-0b3a-419c-8b30-e5edb079d872]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b355d7-0b8d-4078-bc25-bad7993df8dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b00af48-ad85-40b2-9301-05957dee0e64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:17:58 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff685f4-a595-4401-aacf-9fafdda5d006]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.utils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updating existing volume attachment record: e52278e8-eaac-4595-98e0-64337fb6ddb0 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-changed-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing instance network info cache due to event network-changed-0004d2ba-aee3-4a77-8403-261d5583c6c0. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] Acquiring lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] Acquired lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Refreshing network info cache for port 0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:17:58 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32e5f37-15b2-4da2-b87b-5b98e20642c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:17:58 user nova-compute[76391]: No targets found.
Nov 15 23:17:58 user nova-compute[76391]: iSNS:
Nov 15 23:17:58 user nova-compute[76391]: No targets found.
Nov 15 23:17:58 user nova-compute[76391]: STATIC:
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:17:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:17:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:17:58 user nova-compute[76391]: FIRMWARE:
Nov 15 23:17:58 user nova-compute[76391]: No targets found.
Nov 15 23:17:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:17:58 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:17:58 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5bd995-7c91-490c-a5b5-d01c2a8338cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c56d903-f371-4331-8743-50e56d9b1233]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:17:58 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:17:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405a2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59b5829-529f-4014-a05d-297215cb8a57]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26c0dd6-ebf2-42e5-bdbc-17ab27b2bd5f]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e558bc3-8fd3-4001-abc6-eabfa23653ac]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c241c1f6-921e-45cc-9685-92d696ce939e]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f386af0-c55d-42d5-b8c2-c98feb6699b3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299e69c-deaa-4504-81ac-e8e9bf61b82a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]
Nov 15 23:17:58 user nova-compute[76391]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.
Nov 15 23:17:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updated VIF entry in instance network info cache for port 0004d2ba-aee3-4a77-8403-261d5583c6c0. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05f2c9c-108c-470f-b488-31d665608431]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] <== disconnect_volume: return (380ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:17:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3b372871-a9d6-4c99-b899-e702976f714e req-c5007188-7c44-46e6-92c5-de04344b2967 service nova] Releasing lock "refresh_cache-091f63e7-0384-434c-be37-804b10e051fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:17:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVUoZym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': 'cfe1ee59-af8a-479e-a77d-1c7af3ba30fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'serial'} {{(pid=76391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 23:17:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] swap_volume: removing Cinder connection for volume a7bf07ba-d34e-4abd-a7b4-11f316a99669 {{(pid=76391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 23:17:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:17:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] swap_volume: Updating volume a7bf07ba-d34e-4abd-a7b4-11f316a99669 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "pFVUoZym", "auth_password": "jwMduqCLYr3BEg", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "a0e0a774-e0b3-40f1-a288-2212ddda86d6"}, "status": "reserved", "instance": "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa", "attached_at": "", "detached_at": "", "volume_id": "a0e0a774-e0b3-40f1-a288-2212ddda86d6", "serial": "a0e0a774-e0b3-40f1-a288-2212ddda86d6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'no_device': None, 'attachment_id': 'e49516b0-406b-4fa6-9d16-aca4ed08aafa'} {{(pid=76391) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 23:17:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-748727ff-042b-4d73-bc83-33a84f4163e8 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.445s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG os_brick.utils [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19959e0-f616-4083-a22d-682e42c69448]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a28b65e-aafc-4db5-b6dd-1056699da004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dba3a1-051d-4470-9dd2-ecc809d86e71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bbf96b-98a4-4234-902c-d375e721dca0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:18:00 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b75b83-6daf-4159-a4c8-64cf2cd3d0a0]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG os_brick.utils [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:00 user nova-compute[76391]: INFO nova.compute.manager [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Swapping volume a0e0a774-e0b3-40f1-a288-2212ddda86d6 for a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "091f63e7-0384-434c-be37-804b10e051fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:00 user nova-compute[76391]: INFO nova.compute.manager [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Terminating instance
Nov 15 23:18:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-d72953ba-dcf5-400d-9a4d-12b2e08f1fa6 req-1b3090b8-cade-49c4-9101-afc1e1450f58 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d72953ba-dcf5-400d-9a4d-12b2e08f1fa6 req-1b3090b8-cade-49c4-9101-afc1e1450f58 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d72953ba-dcf5-400d-9a4d-12b2e08f1fa6 req-1b3090b8-cade-49c4-9101-afc1e1450f58 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d72953ba-dcf5-400d-9a4d-12b2e08f1fa6 req-1b3090b8-cade-49c4-9101-afc1e1450f58 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-d72953ba-dcf5-400d-9a4d-12b2e08f1fa6 req-1b3090b8-cade-49c4-9101-afc1e1450f58 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-unplugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-d72953ba-dcf5-400d-9a4d-12b2e08f1fa6 req-1b3090b8-cade-49c4-9101-afc1e1450f58 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:01 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee is timed out.
Nov 15 23:18:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Successfully detached device vdb from instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee from the live domain config.
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmCPTZiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:01 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7148b6ac-bbbc-4416-a6d7-9957cf815365]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:01 user nova-compute[76391]: No targets found.
Nov 15 23:18:01 user nova-compute[76391]: iSNS:
Nov 15 23:18:01 user nova-compute[76391]: No targets found.
Nov 15 23:18:01 user nova-compute[76391]: STATIC:
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:01 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:01 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:01 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:01 user nova-compute[76391]: No targets found.
Nov 15 23:18:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:01 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:01 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a938f2-ee5f-4692-818b-cd790c1f1bde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-07001617-e3e2-4e95-9f69-b28e67d2f751 req-451ef715-0d52-4f61-9087-b88ead29b004 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-07001617-e3e2-4e95-9f69-b28e67d2f751 req-451ef715-0d52-4f61-9087-b88ead29b004 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-07001617-e3e2-4e95-9f69-b28e67d2f751 req-451ef715-0d52-4f61-9087-b88ead29b004 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-07001617-e3e2-4e95-9f69-b28e67d2f751 req-451ef715-0d52-4f61-9087-b88ead29b004 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-07001617-e3e2-4e95-9f69-b28e67d2f751 req-451ef715-0d52-4f61-9087-b88ead29b004 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-unplugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-07001617-e3e2-4e95-9f69-b28e67d2f751 req-451ef715-0d52-4f61-9087-b88ead29b004 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-ec59871c-d5a3-463d-9dfa-2ac51320172f for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aaddc2-cdc5-4e37-90e6-f6842fdc930b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:18:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:01 user nova-compute[76391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c (non-flash)
Nov 15 23:18:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405b41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c'): ({'sdi'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Removing single pathed devices sdi {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c322da1-2111-4145-9d9a-2328d2d879b3]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053896f-75e6-4549-9520-9e8140120860]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Flushing IO for device /dev/sdi {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0002f7-dfb1-4c09-98c4-f468fd56a66c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab65cf9-f4ff-42cd-85d6-f8fd6c0d4493]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] SCSI volumes sdi have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e31d0-bcc8-46c1-bf86-70ab2bf97fd0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65301934-aa98-4e10-ad19-75991b2d4faf]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260]
Nov 15 23:18:01 user nova-compute[76391]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc55b68f-e115-4a54-8767-d119cb3aa04c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be77c8e2-66fb-4b3b-9c00-c7eede41a99a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] <== disconnect_volume: return (467ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e7e9310-0003-4769-a15e-917b7684e940 req-2613d214-13e5-45b2-9824-c04b1b69cfbb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e7e9310-0003-4769-a15e-917b7684e940 req-2613d214-13e5-45b2-9824-c04b1b69cfbb service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e7e9310-0003-4769-a15e-917b7684e940 req-2613d214-13e5-45b2-9824-c04b1b69cfbb service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e7e9310-0003-4769-a15e-917b7684e940 req-2613d214-13e5-45b2-9824-c04b1b69cfbb service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e7e9310-0003-4769-a15e-917b7684e940 req-2613d214-13e5-45b2-9824-c04b1b69cfbb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-unplugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e7e9310-0003-4769-a15e-917b7684e940 req-2613d214-13e5-45b2-9824-c04b1b69cfbb service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Instance destroyed successfully.
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.objects.instance [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lazy-loading 'resources' on Instance uuid 091f63e7-0384-434c-be37-804b10e051fb {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:58:86,bridge_name='br-int',has_traffic_filtering=True,id=0004d2ba-aee3-4a77-8403-261d5583c6c0,network=Network(480bdc42-ddd7-47f5-9b90-2319d029d7b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0004d2ba-ae') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:58:86,bridge_name='br-int',has_traffic_filtering=True,id=0004d2ba-aee3-4a77-8403-261d5583c6c0,network=Network(480bdc42-ddd7-47f5-9b90-2319d029d7b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0004d2ba-ae') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0004d2ba-ae, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33b27647-b7b5-419f-b0e8-a94b4b9521e5) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: INFO os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:58:86,bridge_name='br-int',has_traffic_filtering=True,id=0004d2ba-aee3-4a77-8403-261d5583c6c0,network=Network(480bdc42-ddd7-47f5-9b90-2319d029d7b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0004d2ba-ae')
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ec59871c-d5a3-463d-9dfa-2ac51320172f,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec59871c-d5') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ec59871c-d5a3-463d-9dfa-2ac51320172f,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec59871c-d5') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec59871c-d5, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9f5880e-143c-4578-b660-ad49d9404677) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: INFO os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ec59871c-d5a3-463d-9dfa-2ac51320172f,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec59871c-d5')
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:eb:45,bridge_name='br-int',has_traffic_filtering=True,id=fd442b84-7913-4d88-ac96-59504b433218,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd442b84-79') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:eb:45,bridge_name='br-int',has_traffic_filtering=True,id=fd442b84-7913-4d88-ac96-59504b433218,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd442b84-79') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd442b84-79, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c6f0ddd-c06c-48cf-88ec-3cf88a7b4722) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: INFO os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:eb:45,bridge_name='br-int',has_traffic_filtering=True,id=fd442b84-7913-4d88-ac96-59504b433218,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd442b84-79')
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "e7645a3b-6a94-4607-a6a0-8a3084909717", "address": "fa:16:3e:b8:50:5d", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7645a3b-6a", "ovs_interfaceid": "e7645a3b-6a94-4607-a6a0-8a3084909717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:50:5d,bridge_name='br-int',has_traffic_filtering=True,id=e7645a3b-6a94-4607-a6a0-8a3084909717,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7645a3b-6a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:50:5d,bridge_name='br-int',has_traffic_filtering=True,id=e7645a3b-6a94-4607-a6a0-8a3084909717,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7645a3b-6a') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7645a3b-6a, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65974e48-f08b-4427-861c-c57c97fc99b6) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: INFO os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:50:5d,bridge_name='br-int',has_traffic_filtering=True,id=e7645a3b-6a94-4607-a6a0-8a3084909717,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7645a3b-6a')
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbb10e67-350f-4f30-acb7-f1543260d9d6,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb10e67-35') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbb10e67-350f-4f30-acb7-f1543260d9d6,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb10e67-35') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb10e67-35, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fa6846b-cada-424a-8682-89bf1032c9df) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: INFO os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:b3,bridge_name='br-int',has_traffic_filtering=True,id=dbb10e67-350f-4f30-acb7-f1543260d9d6,network=Network(bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb10e67-35')
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:58:57,bridge_name='br-int',has_traffic_filtering=True,id=daed3ff7-f0b2-4a3c-a38a-bba4299814ed,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaed3ff7-f0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:58:57,bridge_name='br-int',has_traffic_filtering=True,id=daed3ff7-f0b2-4a3c-a38a-bba4299814ed,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaed3ff7-f0') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaed3ff7-f0, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=018ec83a-6c25-409f-8511-bed110dee4ca) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: INFO os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:58:57,bridge_name='br-int',has_traffic_filtering=True,id=daed3ff7-f0b2-4a3c-a38a-bba4299814ed,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaed3ff7-f0')
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-983889698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-983889698',id=10,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW8pqTMUnvhUIISE3TTHNVVGNFkEc/G5Wq5hBbIZdtXEM47aHSCNzQbU5rmsfSkAAjiwb9Aw+8v+QbMT+qG3yUGjGtGOAa9XPGgwN3KABzG/o5G6ln1dA10uHVGWhaMGQ==',key_name='tempest-keypair-1689742121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551c857542554b8a9421bea1a7a22de5',ramdisk_id='',reservation_id='r-txc52xp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775805296',owner_user_name='tempest-TaggedBootDevicesTest-1775805296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5c3d1118e142af822c69e72958a213',uuid=091f63e7-0384-434c-be37-804b10e051fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converting VIF {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1d:a6,bridge_name='br-int',has_traffic_filtering=True,id=4a99f526-77c1-4652-aa71-53c3fd056ed9,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a99f526-77') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1d:a6,bridge_name='br-int',has_traffic_filtering=True,id=4a99f526-77c1-4652-aa71-53c3fd056ed9,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a99f526-77') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a99f526-77, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57377fdf-0deb-4996-a018-0d05d171d525) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:03 user nova-compute[76391]: INFO os_vif [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1d:a6,bridge_name='br-int',has_traffic_filtering=True,id=4a99f526-77c1-4652-aa71-53c3fd056ed9,network=Network(23eb2250-81c7-4395-bc5b-6ba24afa278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a99f526-77')
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNxRzHfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ff4fae-53a4-4924-9fff-a54e4c555802]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:03 user nova-compute[76391]: No targets found.
Nov 15 23:18:03 user nova-compute[76391]: iSNS:
Nov 15 23:18:03 user nova-compute[76391]: No targets found.
Nov 15 23:18:03 user nova-compute[76391]: STATIC:
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:03 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:03 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:03 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:03 user nova-compute[76391]: No targets found.
Nov 15 23:18:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:03 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:03 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb72338-5a19-46e9-8d6e-e17a8c7e219e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-0004d2ba-aee3-4a77-8403-261d5583c6c0 for instance with vm_state active and task_state deleting.
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-unplugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-e7645a3b-6a94-4607-a6a0-8a3084909717 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING nova.compute.manager [req-cc2ede98-8d8a-425c-9720-ec56f62bdd00 req-7515925e-f4d5-4d24-8bec-b262d764f121 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-e7645a3b-6a94-4607-a6a0-8a3084909717 for instance with vm_state active and task_state deleting.
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c9328-8407-448d-b765-11d7bf91378c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976038b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8632575f-5db0-4e43-ad9e-740ccfeba0e1]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd17d4e-a52b-4229-a74a-b5da787f512b]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef65b710-53df-418b-b7fa-fc7458c4fdf5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-ec59871c-d5a3-463d-9dfa-2ac51320172f for instance with vm_state active and task_state deleting.
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-unplugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-fd442b84-7913-4d88-ac96-59504b433218 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-fd442b84-7913-4d88-ac96-59504b433218 for instance with vm_state active and task_state deleting.
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-unplugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING nova.compute.manager [req-d97898df-c1df-4dc8-9715-3f0306358c85 req-f9ace8ff-d1d5-4a24-b92c-929e7e540e63 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-dbb10e67-350f-4f30-acb7-f1543260d9d6 for instance with vm_state active and task_state deleting.
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e717339-bbf6-4d3d-a0bb-bdbedb2661b5]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.061s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d33a8-37d9-4753-9fa9-69abc60eeb87]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdnaxop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61d64dd-9fc0-4a0a-8154-f380a6e443e0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260]
Nov 15 23:18:03 user nova-compute[76391]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96568a11-9a18-42f6-8c32-c80ff4171fc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ccc89-bdf2-4263-ae67-4eddf708a26e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== disconnect_volume: return (436ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.112s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:03 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdOaMbVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:03 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7242bb2-1a6e-471b-8cde-a7aff775a31f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:18:03 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b8b118-d511-473e-bf77-f3066a8b135b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5] added
Nov 15 23:18:03 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff3df2d-eafb-45e3-a921-e46e91103c75]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05ea0d7-36cf-46d2-907c-7f36b4aa7955]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLdnaxop {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLdnaxop" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d84503d-605e-406b-9a1a-2aea05bb94b1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tLdnaxop'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f3e029-d393-4012-9f28-bfeb6aa12bfc]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b3c1cd-1289-426e-8dd7-e37a60e3442d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d125760-fc1a-4ae7-8502-0bb617704b03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260]
Nov 15 23:18:04 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cacd44e-74fe-44be-831a-0b8549703cfb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-changed-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing instance network info cache due to event network-changed-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Acquiring lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Acquired lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.network.neutron [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Refreshing network info cache for port e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1acfc-a77d-4d80-a9dc-e2ce90a2d305]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e936a30d-3e10-401d-b57f-2973c8ebe2b0]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdnaxop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:18:04 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Creating image(s)
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Ensure instance console log exists: /opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Start _get_guest_xml network_info=[{"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb286b41-55ed-4a38-8e66-6edb5f0ccd0e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fba4cc50-1dea-41a7-93f3-7c414425be67', 'serial': 'fba4cc50-1dea-41a7-93f3-7c414425be67'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'e52278e8-eaac-4595-98e0-64337fb6ddb0', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:18:04 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 23:18:04 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb286b41-55ed-4a38-8e66-6edb5f0ccd0e {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:04 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:18:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lazy-loading 'flavor' on Instance uuid 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4dc3399d-d867-4cc2-8cf9-620de8168f2a tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.017s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.network.neutron [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updated VIF entry in instance network info cache for port e8af13a5-65d2-4d9e-bfaf-1e7c514b9307. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.network.neutron [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Releasing lock "refresh_cache-737991f4-b661-45db-84ba-53dbb2dce7dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:04 user nova-compute[76391]: WARNING nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-daed3ff7-f0b2-4a3c-a38a-bba4299814ed for instance with vm_state active and task_state deleting.
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-unplugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-unplugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Acquiring lock "091f63e7-0384-434c-be37-804b10e051fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] Lock "091f63e7-0384-434c-be37-804b10e051fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] No waiting events found dispatching network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:04 user nova-compute[76391]: WARNING nova.compute.manager [req-005cbc5b-f4e9-40e9-86bf-c8f8ae3ed5dd req-87e6eb87-7f1b-4a01-a39d-90d8b98d324d service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received unexpected event network-vif-plugged-4a99f526-77c1-4652-aa71-53c3fd056ed9 for instance with vm_state active and task_state deleting.
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '26536623564336530', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536623564336530', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:18:05 user nova-compute[76391]: INFO nova.compute.manager [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Terminating instance
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.393s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.compute.manager [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.objects.instance [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lazy-loading 'flavor' on Instance uuid 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc373c9-1537-453c-9f08-295d2db580a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:05 user nova-compute[76391]: No targets found.
Nov 15 23:18:05 user nova-compute[76391]: iSNS:
Nov 15 23:18:05 user nova-compute[76391]: No targets found.
Nov 15 23:18:05 user nova-compute[76391]: STATIC:
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:05 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:05 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:05 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:05 user nova-compute[76391]: No targets found.
Nov 15 23:18:05 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:05 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:05 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc54181-6c84-4710-a6f7-b56b328426f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 23:18:05 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:05 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:18:05 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:05 user nova-compute[76391]:   <serial>fafc3e88-4847-4dbe-8d54-c8c81ffd2df5</serial>
Nov 15 23:18:05 user nova-compute[76391]: </disk>
Nov 15 23:18:05 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df98e2-415f-4eed-be11-c2afb77d978c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9760388040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162'): ({'sde'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Removing single pathed devices sde {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b211f-1682-4fb5-98be-4390a6b1865d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[357ed985-6b23-47e1-8a42-264bf6a70c9a]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Flushing IO for device /dev/sde {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1039a-2619-4ca0-b6f4-4ebc947f2450]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24b4933-34a1-44d5-a8bc-fd6817a21b9f]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[451662a6-201c-41a8-b1b1-fb68c208dace]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0b4fa6-d516-4cf6-90ce-0897830f3955]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260]
Nov 15 23:18:05 user nova-compute[76391]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:05 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de8cf20f-8bbe-4deb-b093-faaeea42d162 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ebae45-3a66-47ef-b147-b45dd1b5a66d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== disconnect_volume: return (1790ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.176s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:05 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:05 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opGhQJVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:05 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba629aeb-46c7-4437-bf34-187f870ee9dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:18:05 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-93117ac8-42b0-4eaa-b152-df5cd6d46506 req-0c0e3524-1e3d-4108-aa34-c69a19f48cb9 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-93117ac8-42b0-4eaa-b152-df5cd6d46506 req-0c0e3524-1e3d-4108-aa34-c69a19f48cb9 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-93117ac8-42b0-4eaa-b152-df5cd6d46506 req-0c0e3524-1e3d-4108-aa34-c69a19f48cb9 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-93117ac8-42b0-4eaa-b152-df5cd6d46506 req-0c0e3524-1e3d-4108-aa34-c69a19f48cb9 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-93117ac8-42b0-4eaa-b152-df5cd6d46506 req-0c0e3524-1e3d-4108-aa34-c69a19f48cb9 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-unplugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-93117ac8-42b0-4eaa-b152-df5cd6d46506 req-0c0e3524-1e3d-4108-aa34-c69a19f48cb9 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5216e278-68d9-4759-8afd-d1b66fa02c4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67] added
Nov 15 23:18:05 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c54a73-3c9b-4e6d-bd9b-e0d6cb7213a9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3b33aa-dae9-435e-aace-ed6c4ed585d7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] No VIF found with MAC fa:16:3e:df:f1:57, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtkNBJIq {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtkNBJIq" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f473118-1f75-418d-a9ed-451c115a129a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xtkNBJIq'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d6a77a-21e0-4bd2-9314-f3666c1181d7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77be7ef-584e-4714-9895-6eea8efbd45f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:05 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-93dd4e97-6d7b-498b-92db-ad89878bb891 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.838s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2e04425-07a5-43a7-b6b8-fae49f10e333 req-e1f5fbb8-1cf2-4dc7-a7b7-100cf17876e0 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2e04425-07a5-43a7-b6b8-fae49f10e333 req-e1f5fbb8-1cf2-4dc7-a7b7-100cf17876e0 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2e04425-07a5-43a7-b6b8-fae49f10e333 req-e1f5fbb8-1cf2-4dc7-a7b7-100cf17876e0 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2e04425-07a5-43a7-b6b8-fae49f10e333 req-e1f5fbb8-1cf2-4dc7-a7b7-100cf17876e0 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2e04425-07a5-43a7-b6b8-fae49f10e333 req-e1f5fbb8-1cf2-4dc7-a7b7-100cf17876e0 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-unplugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2e04425-07a5-43a7-b6b8-fae49f10e333 req-e1f5fbb8-1cf2-4dc7-a7b7-100cf17876e0 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-c14ea8b5-3068-477f-9885-4fdee03d5700 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --login" returned: 0 in 0.175s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[365493fd-6285-4582-8f57-c797aa381ff8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]
Nov 15 23:18:06 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f7d33a-4015-48fe-b302-5b36801a7cd5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01aad6d-f0dd-4a72-a399-4cabeaaeaced]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.523s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffbacf3-4f3f-48a1-b683-4e43397171a3]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-28e08699-3c04-456c-bcab-739b1cb059dd req-26dace16-ee87-4a72-ad58-3deea0d9c01f service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-28e08699-3c04-456c-bcab-739b1cb059dd req-26dace16-ee87-4a72-ad58-3deea0d9c01f service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-28e08699-3c04-456c-bcab-739b1cb059dd req-26dace16-ee87-4a72-ad58-3deea0d9c01f service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-28e08699-3c04-456c-bcab-739b1cb059dd req-26dace16-ee87-4a72-ad58-3deea0d9c01f service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-28e08699-3c04-456c-bcab-739b1cb059dd req-26dace16-ee87-4a72-ad58-3deea0d9c01f service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-unplugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-28e08699-3c04-456c-bcab-739b1cb059dd req-26dace16-ee87-4a72-ad58-3deea0d9c01f service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] volume_snapshot_create: create_info: {'snapshot_id': '9ef5a895-8c18-47d2-b7c5-c38179b0a33b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=76391) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] snap xml: <domainsnapshot>
Nov 15 23:18:06 user nova-compute[76391]:   <disks>
Nov 15 23:18:06 user nova-compute[76391]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 15 23:18:06 user nova-compute[76391]:       <source file="/dev/new_file"/>
Nov 15 23:18:06 user nova-compute[76391]:     </disk>
Nov 15 23:18:06 user nova-compute[76391]:     <disk name="vda" snapshot="no"/>
Nov 15 23:18:06 user nova-compute[76391]:   </disks>
Nov 15 23:18:06 user nova-compute[76391]: </domainsnapshot>
Nov 15 23:18:06 user nova-compute[76391]:  {{(pid=76391) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] Lazy-loading 'system_metadata' on Instance uuid 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-70c2425f-326e-4d15-bd1c-3f44bc9bd2f1 tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] volume_snapshot_delete: delete_info: {'volume_id': 'fafc3e88-4847-4dbe-8d54-c8c81ffd2df5'} {{(pid=76391) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [None req-70c2425f-326e-4d15-bd1c-3f44bc9bd2f1 tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     if delete_info['type'] != 'qcow2':
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] KeyError: 'type'
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] 
Nov 15 23:18:06 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     rv = execute(f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     six.reraise(c, e, tb)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     raise value
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     rv = meth(*args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     self._volume_snapshot_create(context, instance, guest,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     rv = execute(f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     six.reraise(c, e, tb)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     raise value
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     rv = meth(*args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [None req-70c2425f-326e-4d15-bd1c-3f44bc9bd2f1 tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f42f1177-d236-4f91-b87e-d4aef63bfd50)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server [None req-70c2425f-326e-4d15-bd1c-3f44bc9bd2f1 tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] Exception during message handling: KeyError: 'type'
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server 
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9ef5a895-8c18-47d2-b7c5-c38179b0a33b could not be found.
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9ef5a895-8c18-47d2-b7c5-c38179b0a33b could not be found. (HTTP 404) (Request-ID: req-f4ad0e9e-d71e-446e-ac89-54901200f011)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9ef5a895-8c18-47d2-b7c5-c38179b0a33b could not be found.
Nov 15 23:18:06 user nova-compute[76391]: ERROR nova.virt.libvirt.driver 
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server [None req-8b965684-e251-4a9f-bdd1-72769b05134d tempest-VolumesAssistedSnapshotsTest-1621087783 tempest-VolumesAssistedSnapshotsTest-1621087783-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 23:18:06 user nova-compute[76391]: ERROR oslo_messaging.rpc.server 
Nov 15 23:18:06 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance eba711fe-61e2-4fc1-97cd-1b7322c95173 is timed out.
Nov 15 23:18:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:06 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Successfully detached device sdc from instance eba711fe-61e2-4fc1-97cd-1b7322c95173 from the live domain config.
Nov 15 23:18:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zQPdvbxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:06 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:06 user nova-compute[76391]: INFO nova.compute.manager [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Detaching volume fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:07 user nova-compute[76391]: INFO nova.virt.block_device [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Attempting to driver detach volume fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 from mountpoint /dev/vdb
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Attempting to detach device vdb from instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 23:18:07 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:07 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:18:07 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:07 user nova-compute[76391]:   <serial>fafc3e88-4847-4dbe-8d54-c8c81ffd2df5</serial>
Nov 15 23:18:07 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:18:07 user nova-compute[76391]: </disk>
Nov 15 23:18:07 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Successfully detached device vdb from instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 from the persistent domain config.
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 23:18:07 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:07 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:18:07 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:07 user nova-compute[76391]:   <serial>fafc3e88-4847-4dbe-8d54-c8c81ffd2df5</serial>
Nov 15 23:18:07 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:18:07 user nova-compute[76391]: </disk>
Nov 15 23:18:07 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Instance destroyed successfully.
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.objects.instance [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lazy-loading 'resources' on Instance uuid 737991f4-b661-45db-84ba-53dbb2dce7dc {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.568s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] <== connect_volume: return (2745ms) {'type': 'block', 'scsi_wwn': '26666666437393862', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666666437393862', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.560s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307,network=Network(d0fe1186-1629-4bc6-bc4f-fd520d149fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8af13a5-65') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307,network=Network(d0fe1186-1629-4bc6-bc4f-fd520d149fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8af13a5-65') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8af13a5-65, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d893c-674e-4855-82a9-bac407bbd490]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:07 user nova-compute[76391]: No targets found.
Nov 15 23:18:07 user nova-compute[76391]: iSNS:
Nov 15 23:18:07 user nova-compute[76391]: No targets found.
Nov 15 23:18:07 user nova-compute[76391]: STATIC:
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:07 user nova-compute[76391]: No targets found.
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:07 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:07 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1817328166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1185346505',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgS5owXYTIhp2CyONYKVA6cDqle9QogIygYExxZVew6Eyp+xF5P9KjoNDuUWixbTD8FG5eY4YFl/RQGWgxPOIDDfU+kWnosaJaWDfsFFB/PSD6XOidlEmphF4w4bqLdug==',key_name='tempest-keypair-2000121693',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99cf3b6665eb46cf93ec4b66f688dfe4',ramdisk_id='',reservation_id='r-s984ualt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1456826566',owner_user_name='tempest-ServerActionsV293TestJSON-1456826566-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec4681c47a4458888403c64e96f59d2',uuid=eb286b41-55ed-4a38-8e66-6edb5f0ccd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converting VIF {"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:18:07 user nova-compute[76391]:   <uuid>eb286b41-55ed-4a38-8e66-6edb5f0ccd0e</uuid>
Nov 15 23:18:07 user nova-compute[76391]:   <name>instance-00000006</name>
Nov 15 23:18:07 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:18:07 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:18:07 user nova-compute[76391]:   <metadata>
Nov 15 23:18:07 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:18:07 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:18:07 user nova-compute[76391]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1817328166</nova:name>
Nov 15 23:18:07 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:18:04</nova:creationTime>
Nov 15 23:18:07 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:18:07 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:18:07 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:18:07 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:18:07 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:18:07 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:18:07 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:18:07 user nova-compute[76391]:       <nova:owner>
Nov 15 23:18:07 user nova-compute[76391]:         <nova:user uuid="0ec4681c47a4458888403c64e96f59d2">tempest-ServerActionsV293TestJSON-1456826566-project-member</nova:user>
Nov 15 23:18:07 user nova-compute[76391]:         <nova:project uuid="99cf3b6665eb46cf93ec4b66f688dfe4">tempest-ServerActionsV293TestJSON-1456826566</nova:project>
Nov 15 23:18:07 user nova-compute[76391]:       </nova:owner>
Nov 15 23:18:07 user nova-compute[76391]:       <nova:ports>
Nov 15 23:18:07 user nova-compute[76391]:         <nova:port uuid="b09aad63-4edf-494c-808a-4b0472dfdd18">
Nov 15 23:18:07 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:18:07 user nova-compute[76391]:         </nova:port>
Nov 15 23:18:07 user nova-compute[76391]:       </nova:ports>
Nov 15 23:18:07 user nova-compute[76391]:     </nova:instance>
Nov 15 23:18:07 user nova-compute[76391]:   </metadata>
Nov 15 23:18:07 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:18:07 user nova-compute[76391]:     <system>
Nov 15 23:18:07 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:18:07 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:18:07 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:18:07 user nova-compute[76391]:       <entry name="serial">eb286b41-55ed-4a38-8e66-6edb5f0ccd0e</entry>
Nov 15 23:18:07 user nova-compute[76391]:       <entry name="uuid">eb286b41-55ed-4a38-8e66-6edb5f0ccd0e</entry>
Nov 15 23:18:07 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:18:07 user nova-compute[76391]:     </system>
Nov 15 23:18:07 user nova-compute[76391]:   </sysinfo>
Nov 15 23:18:07 user nova-compute[76391]:   <os>
Nov 15 23:18:07 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:18:07 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:18:07 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:18:07 user nova-compute[76391]:   </os>
Nov 15 23:18:07 user nova-compute[76391]:   <features>
Nov 15 23:18:07 user nova-compute[76391]:     <acpi/>
Nov 15 23:18:07 user nova-compute[76391]:     <apic/>
Nov 15 23:18:07 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:18:07 user nova-compute[76391]:   </features>
Nov 15 23:18:07 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:18:07 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:18:07 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:18:07 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:18:07 user nova-compute[76391]:   </clock>
Nov 15 23:18:07 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:18:07 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:18:07 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:18:07 user nova-compute[76391]:   </cpu>
Nov 15 23:18:07 user nova-compute[76391]:   <devices>
Nov 15 23:18:07 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:18:07 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:07 user nova-compute[76391]:       <source dev="/dev/sdc"/>
Nov 15 23:18:07 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:18:07 user nova-compute[76391]:       <serial>fba4cc50-1dea-41a7-93f3-7c414425be67</serial>
Nov 15 23:18:07 user nova-compute[76391]:     </disk>
Nov 15 23:18:07 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:18:07 user nova-compute[76391]:       <mac address="fa:16:3e:96:ea:ad"/>
Nov 15 23:18:07 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:18:07 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:18:07 user nova-compute[76391]:       <target dev="tapb09aad63-4e"/>
Nov 15 23:18:07 user nova-compute[76391]:     </interface>
Nov 15 23:18:07 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:18:07 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e/console.log" append="off"/>
Nov 15 23:18:07 user nova-compute[76391]:     </serial>
Nov 15 23:18:07 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:18:07 user nova-compute[76391]:     <video>
Nov 15 23:18:07 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:18:07 user nova-compute[76391]:     </video>
Nov 15 23:18:07 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:18:07 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:18:07 user nova-compute[76391]:     </rng>
Nov 15 23:18:07 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:18:07 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:18:07 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:18:07 user nova-compute[76391]:     </memballoon>
Nov 15 23:18:07 user nova-compute[76391]:   </devices>
Nov 15 23:18:07 user nova-compute[76391]: </domain>
Nov 15 23:18:07 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1817328166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1185346505',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgS5owXYTIhp2CyONYKVA6cDqle9QogIygYExxZVew6Eyp+xF5P9KjoNDuUWixbTD8FG5eY4YFl/RQGWgxPOIDDfU+kWnosaJaWDfsFFB/PSD6XOidlEmphF4w4bqLdug==',key_name='tempest-keypair-2000121693',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99cf3b6665eb46cf93ec4b66f688dfe4',ramdisk_id='',reservation_id='r-s984ualt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1456826566',owner_user_name='tempest-ServerActionsV293TestJSON-1456826566-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec4681c47a4458888403c64e96f59d2',uuid=eb286b41-55ed-4a38-8e66-6edb5f0ccd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converting VIF {"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dffc71-7fda-4bde-9e46-1b0fffcb8bbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cfe1ee59-af8a-479e-a77d-1c7af3ba30fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'serial': 'a7bf07ba-d34e-4abd-a7b4-11f316a99669'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVUoZym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'a0e0a774-e0b3-40f1-a288-2212ddda86d6'}, 'status': 'reserved', 'instance': 'cfe1ee59-af8a-479e-a77d-1c7af3ba30fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'serial'} {{(pid=76391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ace78ac-322c-4f2a-8108-661520bd648e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405cbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95'): ({'sdg'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Removing single pathed devices sdg {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:07 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4532d16-250c-4900-b9fd-c08692146a9e) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77d02b2-2d14-4fc0-a1e4-fa09e72ef052]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6704b7b-1a2b-4cc0-9c88-f8a4cb6a59ad]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Flushing IO for device /dev/sdg {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8825d0-bf7b-4df5-b3ac-534f8362af35]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5ff7c9a-030e-5241-aeec-09c1c1ec198b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:c9:b7,bridge_name='br-int',has_traffic_filtering=True,id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307,network=Network(d0fe1186-1629-4bc6-bc4f-fd520d149fb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8af13a5-65')
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d3:86,bridge_name='br-int',has_traffic_filtering=True,id=f5491150-b755-4504-b002-f9739aa210df,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5491150-b7') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d3:86,bridge_name='br-int',has_traffic_filtering=True,id=f5491150-b755-4504-b002-f9739aa210df,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5491150-b7') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f810b-05f6-4fce-8fb1-fd59bfdfac2f]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] SCSI volumes sdg have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5491150-b7, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26a88f-b8fd-4470-b881-407804af5873]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb09aad63-4e, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb09aad63-4e, col_values=(('qos', UUID('029d3987-db28-4e07-8450-fcb1e10ab17a')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb09aad63-4e, col_values=(('external_ids', {'iface-id': 'b09aad63-4edf-494c-808a-4b0472dfdd18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ea:ad', 'vm-uuid': 'eb286b41-55ed-4a38-8e66-6edb5f0ccd0e'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2add9b73-67d8-4236-aa08-590429ba6f1c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260]
Nov 15 23:18:07 user nova-compute[76391]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_vif [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e')
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7e3465f-c70a-497b-98d4-12b42ca68883) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0b36846-5933-4674-ada6-66cee9ee0a95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af85b76-f307-40ca-9eb6-408e225ac9de]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] <== disconnect_volume: return (1918ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Deleting instance files /opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb_del
Nov 15 23:18:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Deletion of /opt/stack/data/nova/instances/091f63e7-0384-434c-be37-804b10e051fb_del complete
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.813s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c38ce-55cf-4a4b-81a8-0b1b704a970d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:07 user nova-compute[76391]: No targets found.
Nov 15 23:18:07 user nova-compute[76391]: iSNS:
Nov 15 23:18:07 user nova-compute[76391]: No targets found.
Nov 15 23:18:07 user nova-compute[76391]: STATIC:
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:07 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:07 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:07 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:07 user nova-compute[76391]: No targets found.
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:07 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:07 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d3:86,bridge_name='br-int',has_traffic_filtering=True,id=f5491150-b755-4504-b002-f9739aa210df,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5491150-b7')
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=c14ea8b5-3068-477f-9885-4fdee03d5700,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc14ea8b5-30') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=c14ea8b5-3068-477f-9885-4fdee03d5700,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc14ea8b5-30') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] No VIF found with MAC fa:16:3e:96:ea:ad, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc14ea8b5-30, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77f2ea2-7c61-462c-b794-43a601822fdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: INFO nova.compute.manager [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Took 6.67 seconds to destroy the instance on the hypervisor.
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 091f63e7-0384-434c-be37-804b10e051fb] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77553fdc-5cab-4418-b26f-0ad677b02546]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97403437f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734'): ({'sdj'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Removing single pathed devices sdj {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16fea3cf-97ec-49c6-93da-4459d3247cb7) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[558ff0b0-8076-4a35-b23a-07a1b470d826]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57566b4-72ed-4f9c-b4fd-e3606b2f34d3]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Flushing IO for device /dev/sdj {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=c14ea8b5-3068-477f-9885-4fdee03d5700,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc14ea8b5-30')
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:e9:ed,bridge_name='br-int',has_traffic_filtering=True,id=181986eb-bb11-4ed8-8caf-547adf633b2a,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181986eb-bb') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:e9:ed,bridge_name='br-int',has_traffic_filtering=True,id=181986eb-bb11-4ed8-8caf-547adf633b2a,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181986eb-bb') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181986eb-bb, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf9e12-63fd-4bfb-aa73-4516c27794e9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:07 user nova-compute[76391]: WARNING nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 for instance with vm_state active and task_state deleting.
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-unplugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-f5491150-b755-4504-b002-f9739aa210df for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:07 user nova-compute[76391]: WARNING nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-f5491150-b755-4504-b002-f9739aa210df for instance with vm_state active and task_state deleting.
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-unplugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-0303a44c-9762-420c-bd6b-d9cacd015e7f for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:07 user nova-compute[76391]: WARNING nova.compute.manager [req-bd2a42d1-c62c-4b7a-9b44-3847e15b14bc req-384cb50e-6e70-47ee-a8ce-cf225ae55c1e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-0303a44c-9762-420c-bd6b-d9cacd015e7f for instance with vm_state active and task_state deleting.
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63b5551a-948e-44ad-b95c-025bd0ab991a) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c4fae1-7375-46b6-95a6-51830be2556c]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] SCSI volumes sdj have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:e9:ed,bridge_name='br-int',has_traffic_filtering=True,id=181986eb-bb11-4ed8-8caf-547adf633b2a,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181986eb-bb')
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "address": "fa:16:3e:99:9e:aa", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23884449-95", "ovs_interfaceid": "23884449-954b-4c2e-b9e0-7daa8f4936e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=23884449-954b-4c2e-b9e0-7daa8f4936e4,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23884449-95') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=23884449-954b-4c2e-b9e0-7daa8f4936e4,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23884449-95') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23884449-95, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f472e47-33fb-45ef-b243-4bf62d1174d0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9275aea8-3bb6-4387-a58b-61ce6aba28e5) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=23884449-954b-4c2e-b9e0-7daa8f4936e4,network=Network(ba5943d7-0e36-4f02-b7b4-c7af36a5af1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23884449-95')
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b1:11,bridge_name='br-int',has_traffic_filtering=True,id=0303a44c-9762-420c-bd6b-d9cacd015e7f,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0303a44c-97') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b1:11,bridge_name='br-int',has_traffic_filtering=True,id=0303a44c-9762-420c-bd6b-d9cacd015e7f,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0303a44c-97') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0303a44c-97, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92416ef2-a2bb-4450-997c-3986686b475e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260]
Nov 15 23:18:07 user nova-compute[76391]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:07 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d25efa3-6d85-4736-8e28-ac5ebe4644f3) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b1:11,bridge_name='br-int',has_traffic_filtering=True,id=0303a44c-9762-420c-bd6b-d9cacd015e7f,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0303a44c-97')
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208280662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208280662',id=11,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/RjhppBXfSdiF3/bqqRXnmQ8Xrhp2mOQXiQl1xAc47g+lM51o0LcJRE4Yhl3VGSKc5angAhNe/B2UNMS2ai3Q/en1MD0QlapbJpYjNHt2vWLdXQki/w5MUoBPkH5sNA==',key_name='tempest-keypair-916637647',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169f440a723149379e44f8fe5872e75d',ramdisk_id='',reservation_id='r-zkm4qlhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419769492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419769492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eaef1c04dca4715b12604ae9ce3fdfa',uuid=737991f4-b661-45db-84ba-53dbb2dce7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converting VIF {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=79a4bdd9-1447-478f-8f4e-db233b27e8bf,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a4bdd9-14') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=79a4bdd9-1447-478f-8f4e-db233b27e8bf,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a4bdd9-14') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0efeee2f-5814-4e9e-baa3-920190cbc734 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[975bf45e-4c67-45be-9bc3-8f3049b175cb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] <== disconnect_volume: return (1178ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79a4bdd9-14, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.636s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:07 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:07 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e42afa3-e4e9-406a-a958-189593fef1a1) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c838863a-82ca-457f-8c23-ca209f78b281]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:18:07 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: INFO os_vif [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=79a4bdd9-1447-478f-8f4e-db233b27e8bf,network=Network(a73bd6f5-e389-4d99-9430-d87f7cd5971a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a4bdd9-14')
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJoDAvdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:08 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf283319-3131-4465-bae0-99c8838f341a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669] added
Nov 15 23:18:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5615a-b1e1-4cc3-94ec-dbc8cf582adf]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:08 user nova-compute[76391]: WARNING nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-c14ea8b5-3068-477f-9885-4fdee03d5700 for instance with vm_state active and task_state deleting.
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-unplugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-181986eb-bb11-4ed8-8caf-547adf633b2a for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:08 user nova-compute[76391]: WARNING nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-181986eb-bb11-4ed8-8caf-547adf633b2a for instance with vm_state active and task_state deleting.
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-unplugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-unplugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:08 user nova-compute[76391]: WARNING nova.compute.manager [req-1bf20875-a58f-4bc9-8ae3-a37d696f0933 req-e7e893da-220b-4c9a-855a-9cedeb950a51 service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-79a4bdd9-1447-478f-8f4e-db233b27e8bf for instance with vm_state active and task_state deleting.
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32ceb6-b8db-4dd7-8033-ada77c8f21a6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaZXSthk {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaZXSthk" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dae82e-d894-4dd0-a56b-a4f9235e3718]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WaZXSthk'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f18a063-cf42-4263-b6d6-fed529323dbf]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b81aed-cd08-4ca3-aaa3-a9c2f1285e69]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f4a9f8-f0af-4e5d-8313-9c3b4a58d698]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]
Nov 15 23:18:08 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[883b85f7-458d-4448-a498-c841888ac322]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ca7b48-4888-4a96-bcde-8c7f86422479]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f50e383-b09b-4e57-b25f-00099d0418f3]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-265e73d8-f3cb-4401-93e5-83e83482d348 req-a94cccd2-eaac-41a7-9bb0-f02639b3092b service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-265e73d8-f3cb-4401-93e5-83e83482d348 req-a94cccd2-eaac-41a7-9bb0-f02639b3092b service nova] Acquiring lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-265e73d8-f3cb-4401-93e5-83e83482d348 req-a94cccd2-eaac-41a7-9bb0-f02639b3092b service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-265e73d8-f3cb-4401-93e5-83e83482d348 req-a94cccd2-eaac-41a7-9bb0-f02639b3092b service nova] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-265e73d8-f3cb-4401-93e5-83e83482d348 req-a94cccd2-eaac-41a7-9bb0-f02639b3092b service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] No waiting events found dispatching network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:08 user nova-compute[76391]: WARNING nova.compute.manager [req-265e73d8-f3cb-4401-93e5-83e83482d348 req-a94cccd2-eaac-41a7-9bb0-f02639b3092b service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received unexpected event network-vif-plugged-23884449-954b-4c2e-b9e0-7daa8f4936e4 for instance with vm_state active and task_state deleting.
Nov 15 23:18:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lazy-loading 'flavor' on Instance uuid eba711fe-61e2-4fc1-97cd-1b7322c95173 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dab9509c-ffda-4ab1-92e4-2fa27c97683c tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.718s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] <== connect_volume: return (1996ms) {'type': 'block', 'scsi_wwn': '23064303964663831', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064303964663831', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.331s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG nova.objects.instance [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lazy-loading 'flavor' on Instance uuid cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65a4aa2-830a-4504-b564-8eda2a561c2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:09 user nova-compute[76391]: No targets found.
Nov 15 23:18:09 user nova-compute[76391]: iSNS:
Nov 15 23:18:09 user nova-compute[76391]: No targets found.
Nov 15 23:18:09 user nova-compute[76391]: STATIC:
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:09 user nova-compute[76391]: No targets found.
Nov 15 23:18:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:09 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:09 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea857470-0bc3-4607-b916-c63136dfa5e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff0a86-1a34-4641-a81c-17fe9be5501f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97403409d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66'): ({'sdd'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Removing single pathed devices sdd {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6136dae3-1243-4bd1-adab-ad6b8d517df5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bdf264-1500-4e82-a232-b39948632eea]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Flushing IO for device /dev/sdd {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c52e28-f4b5-4edc-9c5f-415f389877ac]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be949d7-138f-4db0-ba69-92472cc8a89d]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f9c09-ba2c-4750-87d0-73b2b96e5a08]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a53ec75-8c06-42ad-8a1b-0590357d7837]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260]
Nov 15 23:18:09 user nova-compute[76391]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9a4f449-2580-4ec9-a586-48f4f6afbe66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe180edc-758a-45f8-a5fb-93cb55443251]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== disconnect_volume: return (1726ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfRlSWoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: INFO nova.compute.manager [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Terminating instance
Nov 15 23:18:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf7340-a8a0-4b90-924f-fe65edbafe4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:09 user nova-compute[76391]: No targets found.
Nov 15 23:18:09 user nova-compute[76391]: iSNS:
Nov 15 23:18:09 user nova-compute[76391]: No targets found.
Nov 15 23:18:09 user nova-compute[76391]: STATIC:
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:09 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:09 user nova-compute[76391]: No targets found.
Nov 15 23:18:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:09 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:09 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527003b-d49b-4999-a09c-04087943ddd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb20d55-5dfd-4701-8c02-d913e6673787]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405b6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21847a4d-f8ef-4ebc-af59-278d2349f99f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ded4fe-244f-4ae7-9680-a58c0c8cdc1c]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f510aa-f2e0-4230-9174-42eeba2e64ab]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[331bae88-2a94-4f23-ae27-fcfcf54f4a80]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc6a1d1-ce7c-4ad9-9018-fef7fc6f09b8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-deleted-e7645a3b-6a94-4607-a6a0-8a3084909717 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.compute.manager [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Neutron deleted interface e7645a3b-6a94-4607-a6a0-8a3084909717; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.network.neutron [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "address": "fa:16:3e:82:35:b3", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb10e67-35", "ovs_interfaceid": "dbb10e67-350f-4f30-acb7-f1543260d9d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[176486fa-bef6-4e29-9985-b98a6347e441]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260]
Nov 15 23:18:10 user nova-compute[76391]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 123731968 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Detach interface failed, port_id=e7645a3b-6a94-4607-a6a0-8a3084909717, reason: Instance 091f63e7-0384-434c-be37-804b10e051fb could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-deleted-dbb10e67-350f-4f30-acb7-f1543260d9d6 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.compute.manager [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Neutron deleted interface dbb10e67-350f-4f30-acb7-f1543260d9d6; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.network.neutron [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "address": "fa:16:3e:52:1d:a6", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a99f526-77", "ovs_interfaceid": "4a99f526-77c1-4652-aa71-53c3fd056ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c74feb-a2d8-47af-82d6-4dfe4f5fe075 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16803365-b02d-4ba5-8d6c-59063363d0b8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.558s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== disconnect_volume: return (560ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-50a1a8f7-511a-4158-8bc2-31a40538b830 req-1a3fd96f-fa54-442a-aba9-54809f6975a9 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Detach interface failed, port_id=dbb10e67-350f-4f30-acb7-f1543260d9d6, reason: Instance 091f63e7-0384-434c-be37-804b10e051fb could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiGkqhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:10 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c616ed56-89b5-489b-9f1f-f2908d123496]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:10 user nova-compute[76391]: No targets found.
Nov 15 23:18:10 user nova-compute[76391]: iSNS:
Nov 15 23:18:10 user nova-compute[76391]: No targets found.
Nov 15 23:18:10 user nova-compute[76391]: STATIC:
Nov 15 23:18:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9
Nov 15 23:18:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:10 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:10 user nova-compute[76391]: No targets found.
Nov 15 23:18:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:10 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:10 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d17068-9553-4164-98df-f36fb8cd1574]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[975cc1bb-ab2f-489b-8f85-d291c685e21c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 (non-flash)
Nov 15 23:18:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976d4dd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9'): ({'sdh'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Removing single pathed devices sdh {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:10 user nova-compute[76391]: WARNING nova.compute.manager [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received unexpected event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:10 user nova-compute[76391]: WARNING nova.compute.manager [req-56660645-9c46-43f7-9a63-379a8caa0348 req-8159bedf-0d2d-405b-9d7f-83fe4f1e4280 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received unexpected event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fa1154-8f75-4cda-af03-48d6e8469223]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd7cb36-6970-461d-9edb-a81d564d75a1]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Flushing IO for device /dev/sdh {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e469661c-a331-4f70-bdd5-47fdafc03228]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f78d38-7bfb-4220-8656-f6ddbb82b525]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] SCSI volumes sdh have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dba22de-c853-4094-89fa-0f29bb11e690]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f55c5-f3fb-4129-bac4-73dae01d16ce]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260]
Nov 15 23:18:10 user nova-compute[76391]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 329252864 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f873ae-23d9-4b7a-ba99-606763b5a9a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff690908-b7e5-4797-ba56-e9eea90f26b8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] <== disconnect_volume: return (493ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Deleting instance files /opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc_del
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Deletion of /opt/stack/data/nova/instances/737991f4-b661-45db-84ba-53dbb2dce7dc_del complete
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Instance destroyed successfully.
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lazy-loading 'resources' on Instance uuid eba711fe-61e2-4fc1-97cd-1b7322c95173 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-151591415',display_name='tempest-AttachSCSIVolumeTestJSON-server-151591415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-151591415',id=5,image_ref='73853c66-7f22-4aaf-ad23-d26c56c4c809',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEwWX8sLYjYMIPxG4KJbvoLuv5oic4QOmSA1HLgtMUCTmv9VzbyZ+VHKWMPv8Tb/nqZAkgLy932fzYjg3hOvMpxRZblFdHXeKahR+jyemIgkMWRXnGSCFYQGUrFCPuuYA==',key_name='tempest-keypair-694647929',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bea310cd7c247c995446fca1b6e590b',ramdisk_id='',reservation_id='r-7p7i01g2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73853c66-7f22-4aaf-ad23-d26c56c4c809',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-979196840',owner_user_name='tempest-AttachSCSIVolumeTestJSON-979196840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='455bcb01ce974a3ea1e76e68d749ab65',uuid=eba711fe-61e2-4fc1-97cd-1b7322c95173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Converting VIF {"id": "81efae21-a14a-4c0e-8624-29fe2977d41d", "address": "fa:16:3e:03:da:bd", "network": {"id": "d96de21a-bfba-42b8-bcc7-92d826362bf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-980640904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bea310cd7c247c995446fca1b6e590b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81efae21-a1", "ovs_interfaceid": "81efae21-a14a-4c0e-8624-29fe2977d41d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=81efae21-a14a-4c0e-8624-29fe2977d41d,network=Network(d96de21a-bfba-42b8-bcc7-92d826362bf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81efae21-a1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG os_vif [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=81efae21-a14a-4c0e-8624-29fe2977d41d,network=Network(d96de21a-bfba-42b8-bcc7-92d826362bf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81efae21-a1') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81efae21-a1, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be954d89-67e3-4bc4-9212-4e64b28c3c3c) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:10 user nova-compute[76391]: INFO os_vif [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=81efae21-a14a-4c0e-8624-29fe2977d41d,network=Network(d96de21a-bfba-42b8-bcc7-92d826362bf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81efae21-a1')
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Deleting instance files /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173_del
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Deletion of /opt/stack/data/nova/instances/eba711fe-61e2-4fc1-97cd-1b7322c95173_del complete
Nov 15 23:18:10 user nova-compute[76391]: INFO nova.compute.manager [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Took 5.72 seconds to destroy the instance on the hypervisor.
Nov 15 23:18:10 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:18:10 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:18:11 user nova-compute[76391]: INFO nova.compute.manager [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 507510784 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:18:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance spawned successfully.
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 646971392 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:11 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a928dcdd-b214-4e5f-84e5-76633d313e4b is timed out.
Nov 15 23:18:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully detached device vdb from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the live domain config.
Nov 15 23:18:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbpFEPSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:11 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc7900-6f75-4643-9635-e936d3af322a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:11 user nova-compute[76391]: No targets found.
Nov 15 23:18:11 user nova-compute[76391]: iSNS:
Nov 15 23:18:11 user nova-compute[76391]: No targets found.
Nov 15 23:18:11 user nova-compute[76391]: STATIC:
Nov 15 23:18:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41
Nov 15 23:18:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:11 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:11 user nova-compute[76391]: No targets found.
Nov 15 23:18:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:11 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:11 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9fade1-8d01-4098-bbee-584bb4ac4280]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b045e6f2-f1a8-4e97-b98f-678720163ee5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405cab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41'): ({'sdl'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Removing single pathed devices sdl {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8245b5e5-e11a-4291-87a8-ec232a365744 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.147s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d647271-2c5c-424f-bd2b-e35b34f0482f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca526b84-332b-4d85-84ae-144400133c79]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Flushing IO for device /dev/sdl {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e86db2-3f06-4eb4-b858-e4c209898bf5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.059s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99d942a-a44a-4b6e-ae57-3ff16d50652c]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] SCSI volumes sdl have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe7320-6aa9-4449-9764-3fa95f5ed188]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe33835-3868-484c-801b-2dc4bd573e4b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260]
Nov 15 23:18:12 user nova-compute[76391]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-vif-unplugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] No waiting events found dispatching network-vif-unplugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-vif-unplugged-81efae21-a14a-4c0e-8624-29fe2977d41d for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-deleted-4a99f526-77c1-4652-aa71-53c3fd056ed9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:12 user nova-compute[76391]: INFO nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Neutron deleted interface 4a99f526-77c1-4652-aa71-53c3fd056ed9; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [{"id": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "address": "fa:16:3e:86:58:86", "network": {"id": "480bdc42-ddd7-47f5-9b90-2319d029d7b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-300851404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0004d2ba-ae", "ovs_interfaceid": "0004d2ba-aee3-4a77-8403-261d5583c6c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "address": "fa:16:3e:6a:9d:8a", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec59871c-d5", "ovs_interfaceid": "ec59871c-d5a3-463d-9dfa-2ac51320172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd442b84-7913-4d88-ac96-59504b433218", "address": "fa:16:3e:c8:eb:45", "network": {"id": "bd01ced0-2b2b-40ad-9e4e-6e6f8d1769ee", "bridge": "br-int", "label": "tempest-device-tagging-net1-1302217360", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd442b84-79", "ovs_interfaceid": "fd442b84-7913-4d88-ac96-59504b433218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "address": "fa:16:3e:3c:58:57", "network": {"id": "23eb2250-81c7-4395-bc5b-6ba24afa278e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1067572299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "551c857542554b8a9421bea1a7a22de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaed3ff7-f0", "ovs_interfaceid": "daed3ff7-f0b2-4a3c-a38a-bba4299814ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98725c2b-e8bc-4f9a-875d-73f6e6d86e41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.063s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c24513-7a8d-41a3-9fe0-0e80f0f462a9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] <== disconnect_volume: return (470ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 794820608 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Detach interface failed, port_id=4a99f526-77c1-4652-aa71-53c3fd056ed9, reason: Instance 091f63e7-0384-434c-be37-804b10e051fb could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] Acquiring lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] No waiting events found dispatching network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:12 user nova-compute[76391]: WARNING nova.compute.manager [req-2bd49364-b379-4797-bbc8-4305ef067658 req-d6001b23-f950-4ea6-b4d6-707555cef8a8 service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received unexpected event network-vif-plugged-81efae21-a14a-4c0e-8624-29fe2977d41d for instance with vm_state active and task_state deleting.
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updating instance_info_cache with network_info: [{"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 927989760 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 1053818880 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'flavor' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9b0009ac-e744-419a-8ba6-e2b44c1fe720 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.320s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:18:13 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Took 6.27 seconds to deallocate network for instance.
Nov 15 23:18:13 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "interface-a928dcdd-b214-4e5f-84e5-76633d313e4b-1cfba799-5f77-44cb-a9b5-86902b7456e4" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "interface-a928dcdd-b214-4e5f-84e5-76633d313e4b-1cfba799-5f77-44cb-a9b5-86902b7456e4" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:13 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Took 2.92 seconds to deallocate network for instance.
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'flavor' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392690336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392690336',id=7,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0IspOOwh4AxJxavAWXMIXxyzIMrl5nEywXM3UCkaIXrQ4id+z3X0cGmiwOi/O0sqc9uZ5aEcv3TENtVTyqVPRYbiCBkzRNPUHJ+VUjOn4PSSiaFmNQVRgZ33uNsYuXlQ==',key_name='tempest-keypair-210828776',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e14a7df237f84c518de0804a57254975',ramdisk_id='',reservation_id='r-kti4w7p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986589477',owner_user_name='tempest-TaggedAttachmentsTest-1986589477-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538446003d4147a586ba8675a3fbef81',uuid=a928dcdd-b214-4e5f-84e5-76633d313e4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converting VIF {"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e1:86:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap1cfba799-5f"/></interface> {{(pid=76391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVUoZym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'a0e0a774-e0b3-40f1-a288-2212ddda86d6'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:14 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e1:86:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap1cfba799-5f"/></interface> {{(pid=76391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Attempting to detach device tap1cfba799-5f from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] detach device xml: <interface type="ethernet">
Nov 15 23:18:14 user nova-compute[76391]:   <mac address="fa:16:3e:e1:86:34"/>
Nov 15 23:18:14 user nova-compute[76391]:   <model type="virtio"/>
Nov 15 23:18:14 user nova-compute[76391]:   <mtu size="1442"/>
Nov 15 23:18:14 user nova-compute[76391]:   <target dev="tap1cfba799-5f"/>
Nov 15 23:18:14 user nova-compute[76391]: </interface>
Nov 15 23:18:14 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e1:86:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap1cfba799-5f"/></interface> {{(pid=76391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e1:86:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap1cfba799-5f"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 15 23:18:14 user nova-compute[76391]:   <name>instance-00000007</name>
Nov 15 23:18:14 user nova-compute[76391]:   <uuid>a928dcdd-b214-4e5f-84e5-76633d313e4b</uuid>
Nov 15 23:18:14 user nova-compute[76391]:   <metadata>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:18:14 user nova-compute[76391]:   <nova:package version="0.0.0"/>
Nov 15 23:18:14 user nova-compute[76391]:   <nova:name>tempest-device-tagging-server-392690336</nova:name>
Nov 15 23:18:14 user nova-compute[76391]:   <nova:creationTime>2023-11-15 23:17:41</nova:creationTime>
Nov 15 23:18:14 user nova-compute[76391]:   <nova:flavor name="m1.tiny">
Nov 15 23:18:14 user nova-compute[76391]:     <nova:memory>512</nova:memory>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:disk>1</nova:disk>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:swap>0</nova:swap>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 23:18:14 user nova-compute[76391]:   </nova:flavor>
Nov 15 23:18:14 user nova-compute[76391]:   <nova:owner>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:user uuid="538446003d4147a586ba8675a3fbef81">tempest-TaggedAttachmentsTest-1986589477-project-member</nova:user>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:project uuid="e14a7df237f84c518de0804a57254975">tempest-TaggedAttachmentsTest-1986589477</nova:project>
Nov 15 23:18:14 user nova-compute[76391]:   </nova:owner>
Nov 15 23:18:14 user nova-compute[76391]:   <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:18:14 user nova-compute[76391]:   <nova:ports>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:port uuid="9722bca6-f5a9-46c2-81ab-f50b88433b28">
Nov 15 23:18:14 user nova-compute[76391]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:18:14 user nova-compute[76391]:     </nova:port>
Nov 15 23:18:14 user nova-compute[76391]:     <nova:port uuid="1cfba799-5f77-44cb-a9b5-86902b7456e4">
Nov 15 23:18:14 user nova-compute[76391]:       <nova:ip type="fixed" address="10.10.10.149" ipVersion="4"/>
Nov 15 23:18:14 user nova-compute[76391]:     </nova:port>
Nov 15 23:18:14 user nova-compute[76391]:   </nova:ports>
Nov 15 23:18:14 user nova-compute[76391]: </nova:instance>
Nov 15 23:18:14 user nova-compute[76391]:   </metadata>
Nov 15 23:18:14 user nova-compute[76391]:   <memory unit='KiB'>524288</memory>
Nov 15 23:18:14 user nova-compute[76391]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 23:18:14 user nova-compute[76391]:   <vcpu placement='static'>1</vcpu>
Nov 15 23:18:14 user nova-compute[76391]:   <resource>
Nov 15 23:18:14 user nova-compute[76391]:     <partition>/machine</partition>
Nov 15 23:18:14 user nova-compute[76391]:   </resource>
Nov 15 23:18:14 user nova-compute[76391]:   <sysinfo type='smbios'>
Nov 15 23:18:14 user nova-compute[76391]:     <system>
Nov 15 23:18:14 user nova-compute[76391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 23:18:14 user nova-compute[76391]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 23:18:14 user nova-compute[76391]:       <entry name='version'>0.0.0</entry>
Nov 15 23:18:14 user nova-compute[76391]:       <entry name='serial'>a928dcdd-b214-4e5f-84e5-76633d313e4b</entry>
Nov 15 23:18:14 user nova-compute[76391]:       <entry name='uuid'>a928dcdd-b214-4e5f-84e5-76633d313e4b</entry>
Nov 15 23:18:14 user nova-compute[76391]:       <entry name='family'>Virtual Machine</entry>
Nov 15 23:18:14 user nova-compute[76391]:     </system>
Nov 15 23:18:14 user nova-compute[76391]:   </sysinfo>
Nov 15 23:18:14 user nova-compute[76391]:   <os>
Nov 15 23:18:14 user nova-compute[76391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 23:18:14 user nova-compute[76391]:     <boot dev='hd'/>
Nov 15 23:18:14 user nova-compute[76391]:     <smbios mode='sysinfo'/>
Nov 15 23:18:14 user nova-compute[76391]:   </os>
Nov 15 23:18:14 user nova-compute[76391]:   <features>
Nov 15 23:18:14 user nova-compute[76391]:     <acpi/>
Nov 15 23:18:14 user nova-compute[76391]:     <apic/>
Nov 15 23:18:14 user nova-compute[76391]:     <vmcoreinfo state='on'/>
Nov 15 23:18:14 user nova-compute[76391]:   </features>
Nov 15 23:18:14 user nova-compute[76391]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 23:18:14 user nova-compute[76391]:     <model fallback='forbid'>Nehalem</model>
Nov 15 23:18:14 user nova-compute[76391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 23:18:14 user nova-compute[76391]:     <feature policy='require' name='vme'/>
Nov 15 23:18:14 user nova-compute[76391]:     <feature policy='require' name='x2apic'/>
Nov 15 23:18:14 user nova-compute[76391]:     <feature policy='require' name='hypervisor'/>
Nov 15 23:18:14 user nova-compute[76391]:   </cpu>
Nov 15 23:18:14 user nova-compute[76391]:   <clock offset='utc'>
Nov 15 23:18:14 user nova-compute[76391]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 23:18:14 user nova-compute[76391]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 23:18:14 user nova-compute[76391]:     <timer name='hpet' present='no'/>
Nov 15 23:18:14 user nova-compute[76391]:   </clock>
Nov 15 23:18:14 user nova-compute[76391]:   <on_poweroff>destroy</on_poweroff>
Nov 15 23:18:14 user nova-compute[76391]:   <on_reboot>restart</on_reboot>
Nov 15 23:18:14 user nova-compute[76391]:   <on_crash>destroy</on_crash>
Nov 15 23:18:14 user nova-compute[76391]:   <devices>
Nov 15 23:18:14 user nova-compute[76391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 23:18:14 user nova-compute[76391]:     <disk type='file' device='disk'>
Nov 15 23:18:14 user nova-compute[76391]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 23:18:14 user nova-compute[76391]:       <source file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk' index='2'/>
Nov 15 23:18:14 user nova-compute[76391]:       <backingStore type='file' index='3'>
Nov 15 23:18:14 user nova-compute[76391]:         <format type='raw'/>
Nov 15 23:18:14 user nova-compute[76391]:         <source file='/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c'/>
Nov 15 23:18:14 user nova-compute[76391]:         <backingStore/>
Nov 15 23:18:14 user nova-compute[76391]:       </backingStore>
Nov 15 23:18:14 user nova-compute[76391]:       <target dev='vda' bus='virtio'/>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='virtio-disk0'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </disk>
Nov 15 23:18:14 user nova-compute[76391]:     <disk type='file' device='cdrom'>
Nov 15 23:18:14 user nova-compute[76391]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 23:18:14 user nova-compute[76391]:       <source file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.config' index='1'/>
Nov 15 23:18:14 user nova-compute[76391]:       <backingStore/>
Nov 15 23:18:14 user nova-compute[76391]:       <target dev='hda' bus='ide'/>
Nov 15 23:18:14 user nova-compute[76391]:       <readonly/>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='ide0-0-0'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </disk>
Nov 15 23:18:14 user nova-compute[76391]:     <controller type='usb' index='0' model='none'>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='usb'/>
Nov 15 23:18:14 user nova-compute[76391]:     </controller>
Nov 15 23:18:14 user nova-compute[76391]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='pci.0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </controller>
Nov 15 23:18:14 user nova-compute[76391]:     <controller type='ide' index='0'>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='ide'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 23:18:14 user nova-compute[76391]:     </controller>
Nov 15 23:18:14 user nova-compute[76391]:     <interface type='ethernet'>
Nov 15 23:18:14 user nova-compute[76391]:       <mac address='fa:16:3e:fb:23:fb'/>
Nov 15 23:18:14 user nova-compute[76391]:       <target dev='tap9722bca6-f5'/>
Nov 15 23:18:14 user nova-compute[76391]:       <model type='virtio'/>
Nov 15 23:18:14 user nova-compute[76391]:       <mtu size='1442'/>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='net0'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </interface>
Nov 15 23:18:14 user nova-compute[76391]:     <interface type='ethernet'>
Nov 15 23:18:14 user nova-compute[76391]:       <mac address='fa:16:3e:e1:86:34'/>
Nov 15 23:18:14 user nova-compute[76391]:       <target dev='tap1cfba799-5f'/>
Nov 15 23:18:14 user nova-compute[76391]:       <model type='virtio'/>
Nov 15 23:18:14 user nova-compute[76391]:       <mtu size='1442'/>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='net1'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </interface>
Nov 15 23:18:14 user nova-compute[76391]:     <serial type='pty'>
Nov 15 23:18:14 user nova-compute[76391]:       <source path='/dev/pts/5'/>
Nov 15 23:18:14 user nova-compute[76391]:       <log file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/console.log' append='off'/>
Nov 15 23:18:14 user nova-compute[76391]:       <target type='isa-serial' port='0'>
Nov 15 23:18:14 user nova-compute[76391]:         <model name='isa-serial'/>
Nov 15 23:18:14 user nova-compute[76391]:       </target>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='serial0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </serial>
Nov 15 23:18:14 user nova-compute[76391]:     <console type='pty' tty='/dev/pts/5'>
Nov 15 23:18:14 user nova-compute[76391]:       <source path='/dev/pts/5'/>
Nov 15 23:18:14 user nova-compute[76391]:       <log file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/console.log' append='off'/>
Nov 15 23:18:14 user nova-compute[76391]:       <target type='serial' port='0'/>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='serial0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </console>
Nov 15 23:18:14 user nova-compute[76391]:     <input type='mouse' bus='ps2'>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='input0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </input>
Nov 15 23:18:14 user nova-compute[76391]:     <input type='keyboard' bus='ps2'>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='input1'/>
Nov 15 23:18:14 user nova-compute[76391]:     </input>
Nov 15 23:18:14 user nova-compute[76391]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 15 23:18:14 user nova-compute[76391]:       <listen type='address' address='0.0.0.0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </graphics>
Nov 15 23:18:14 user nova-compute[76391]:     <audio id='1' type='none'/>
Nov 15 23:18:14 user nova-compute[76391]:     <video>
Nov 15 23:18:14 user nova-compute[76391]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='video0'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </video>
Nov 15 23:18:14 user nova-compute[76391]:     <memballoon model='virtio'>
Nov 15 23:18:14 user nova-compute[76391]:       <stats period='10'/>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='balloon0'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </memballoon>
Nov 15 23:18:14 user nova-compute[76391]:     <rng model='virtio'>
Nov 15 23:18:14 user nova-compute[76391]:       <backend model='random'>/dev/urandom</backend>
Nov 15 23:18:14 user nova-compute[76391]:       <alias name='rng0'/>
Nov 15 23:18:14 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 23:18:14 user nova-compute[76391]:     </rng>
Nov 15 23:18:14 user nova-compute[76391]:   </devices>
Nov 15 23:18:14 user nova-compute[76391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 23:18:14 user nova-compute[76391]:     <label>libvirt-a928dcdd-b214-4e5f-84e5-76633d313e4b</label>
Nov 15 23:18:14 user nova-compute[76391]:     <imagelabel>libvirt-a928dcdd-b214-4e5f-84e5-76633d313e4b</imagelabel>
Nov 15 23:18:14 user nova-compute[76391]:   </seclabel>
Nov 15 23:18:14 user nova-compute[76391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 23:18:14 user nova-compute[76391]:     <label>+64055:+108</label>
Nov 15 23:18:14 user nova-compute[76391]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 23:18:14 user nova-compute[76391]:   </seclabel>
Nov 15 23:18:14 user nova-compute[76391]: </domain>
Nov 15 23:18:14 user nova-compute[76391]:  {{(pid=76391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 23:18:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully detached device tap1cfba799-5f from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the persistent domain config.
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] (1/8): Attempting to detach device tap1cfba799-5f with device alias net1 from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] detach device xml: <interface type="ethernet">
Nov 15 23:18:14 user nova-compute[76391]:   <mac address="fa:16:3e:e1:86:34"/>
Nov 15 23:18:14 user nova-compute[76391]:   <model type="virtio"/>
Nov 15 23:18:14 user nova-compute[76391]:   <mtu size="1442"/>
Nov 15 23:18:14 user nova-compute[76391]:   <target dev="tap1cfba799-5f"/>
Nov 15 23:18:14 user nova-compute[76391]: </interface>
Nov 15 23:18:14 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[717795fa-e7bc-4e24-8f8a-eefda3b65a2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:14 user nova-compute[76391]: No targets found.
Nov 15 23:18:14 user nova-compute[76391]: iSNS:
Nov 15 23:18:14 user nova-compute[76391]: No targets found.
Nov 15 23:18:14 user nova-compute[76391]: STATIC:
Nov 15 23:18:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6
Nov 15 23:18:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:14 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:14 user nova-compute[76391]: No targets found.
Nov 15 23:18:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:14 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:14 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b16a51f-a0c6-4348-b1f7-cbb7ad1b5963]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39542c9-702b-41ed-81e7-316b24d01c0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740596f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6'): ({'sdm'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Removing single pathed devices sdm {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b26f8-5497-4072-99dc-c6476ff7a01e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f94c5-78aa-4c67-959b-c511ec289f27]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Flushing IO for device /dev/sdm {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f060ebd-4792-4190-8df3-752248e1a7d9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.057s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9118bccc-92a6-4de0-8ab3-0496b0711fd1]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] SCSI volumes sdm have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04652f7d-477b-41ac-9a99-5e22fcaf36db]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-142f9b76-a6b9-4dbd-9dea-b79dc1a56f43 req-3e046163-25a9-4f03-bfa1-666d7e6db4ee service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-deleted-0004d2ba-aee3-4a77-8403-261d5583c6c0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-142f9b76-a6b9-4dbd-9dea-b79dc1a56f43 req-3e046163-25a9-4f03-bfa1-666d7e6db4ee service nova] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Received event network-vif-deleted-daed3ff7-f0b2-4a3c-a38a-bba4299814ed {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-142f9b76-a6b9-4dbd-9dea-b79dc1a56f43 req-3e046163-25a9-4f03-bfa1-666d7e6db4ee service nova] [instance: eba711fe-61e2-4fc1-97cd-1b7322c95173] Received event network-vif-deleted-81efae21-a14a-4c0e-8624-29fe2977d41d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Start waiting for the detach event from libvirt for device tap1cfba799-5f with device alias net1 for instance a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e043fe9-ea29-4232-bd0b-0e8ba6f60a8a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260]
Nov 15 23:18:14 user nova-compute[76391]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e0a774-e0b3-40f1-a288-2212ddda86d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71ec3ea-74a8-4ece-b8c6-5593ed39b251]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] <== disconnect_volume: return (426ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cfe1ee59-af8a-479e-a77d-1c7af3ba30fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'serial'} {{(pid=76391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] swap_volume: removing Cinder connection for volume a0e0a774-e0b3-40f1-a288-2212ddda86d6 {{(pid=76391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-30d24b66-fa69-417e-b6e4-b9036df167b0 req-370c37c6-24ee-4987-8e90-71b4cc240c80 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-unplugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-30d24b66-fa69-417e-b6e4-b9036df167b0 req-370c37c6-24ee-4987-8e90-71b4cc240c80 service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-30d24b66-fa69-417e-b6e4-b9036df167b0 req-370c37c6-24ee-4987-8e90-71b4cc240c80 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-30d24b66-fa69-417e-b6e4-b9036df167b0 req-370c37c6-24ee-4987-8e90-71b4cc240c80 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-30d24b66-fa69-417e-b6e4-b9036df167b0 req-370c37c6-24ee-4987-8e90-71b4cc240c80 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-unplugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:14 user nova-compute[76391]: WARNING nova.compute.manager [req-30d24b66-fa69-417e-b6e4-b9036df167b0 req-370c37c6-24ee-4987-8e90-71b4cc240c80 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received unexpected event network-vif-unplugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 for instance with vm_state active and task_state None.
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.161s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:18:14 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Deleted allocations for instance eba711fe-61e2-4fc1-97cd-1b7322c95173
Nov 15 23:18:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a13e6638-1ade-41f6-bff3-9dd8aac0888e tempest-AttachSCSIVolumeTestJSON-979196840 tempest-AttachSCSIVolumeTestJSON-979196840-project-member] Lock "eba711fe-61e2-4fc1-97cd-1b7322c95173" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.056s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:18:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG nova.compute.manager [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] swap_volume: Updating volume a0e0a774-e0b3-40f1-a288-2212ddda86d6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WaZXSthk", "auth_password": "Sa9A3GjXgwvFLT", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "a7bf07ba-d34e-4abd-a7b4-11f316a99669"}, "status": "reserved", "instance": "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa", "attached_at": "", "detached_at": "", "volume_id": "a7bf07ba-d34e-4abd-a7b4-11f316a99669", "serial": "a7bf07ba-d34e-4abd-a7b4-11f316a99669"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'no_device': None, 'attachment_id': '832f395e-8264-4f8c-bf45-5c8848b92e14'} {{(pid=76391) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-20e9c252-a1d8-4264-b1d8-8d4b12740be6 tempest-TestVolumeSwap-1530579439 tempest-TestVolumeSwap-1530579439-project-admin] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.905s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-deleted-23884449-954b-4c2e-b9e0-7daa8f4936e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Neutron deleted interface 23884449-954b-4c2e-b9e0-7daa8f4936e4; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "address": "fa:16:3e:11:c9:b7", "network": {"id": "d0fe1186-1629-4bc6-bc4f-fd520d149fb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1017369850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8af13a5-65", "ovs_interfaceid": "e8af13a5-65d2-4d9e-bfaf-1e7c514b9307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Took 5.47 seconds to deallocate network for instance.
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Detach interface failed, port_id=23884449-954b-4c2e-b9e0-7daa8f4936e4, reason: Instance 737991f4-b661-45db-84ba-53dbb2dce7dc could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-deleted-e8af13a5-65d2-4d9e-bfaf-1e7c514b9307 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Neutron deleted interface e8af13a5-65d2-4d9e-bfaf-1e7c514b9307; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "address": "fa:16:3e:b3:cc:69", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a4bdd9-14", "ovs_interfaceid": "79a4bdd9-1447-478f-8f4e-db233b27e8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Detaching volume a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Detach interface failed, port_id=e8af13a5-65d2-4d9e-bfaf-1e7c514b9307, reason: Instance 737991f4-b661-45db-84ba-53dbb2dce7dc could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-deleted-79a4bdd9-1447-478f-8f4e-db233b27e8bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Neutron deleted interface 79a4bdd9-1447-478f-8f4e-db233b27e8bf; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "181986eb-bb11-4ed8-8caf-547adf633b2a", "address": "fa:16:3e:49:e9:ed", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181986eb-bb", "ovs_interfaceid": "181986eb-bb11-4ed8-8caf-547adf633b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Detach interface failed, port_id=79a4bdd9-1447-478f-8f4e-db233b27e8bf, reason: Instance 737991f4-b661-45db-84ba-53dbb2dce7dc could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-deleted-181986eb-bb11-4ed8-8caf-547adf633b2a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Neutron deleted interface 181986eb-bb11-4ed8-8caf-547adf633b2a; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "address": "fa:16:3e:26:b1:11", "network": {"id": "a73bd6f5-e389-4d99-9430-d87f7cd5971a", "bridge": "br-int", "label": "tempest-device-tagging-net2-969550655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0303a44c-97", "ovs_interfaceid": "0303a44c-9762-420c-bd6b-d9cacd015e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.virt.block_device [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Attempting to driver detach volume a7bf07ba-d34e-4abd-a7b4-11f316a99669 from mountpoint /dev/vdb
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Detach interface failed, port_id=181986eb-bb11-4ed8-8caf-547adf633b2a, reason: Instance 737991f4-b661-45db-84ba-53dbb2dce7dc could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Received event network-vif-deleted-0303a44c-9762-420c-bd6b-d9cacd015e7f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Neutron deleted interface 0303a44c-9762-420c-bd6b-d9cacd015e7f; detaching it from the instance and deleting it from the info cache
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Updating instance_info_cache with network_info: [{"id": "f5491150-b755-4504-b002-f9739aa210df", "address": "fa:16:3e:d3:d3:86", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5491150-b7", "ovs_interfaceid": "f5491150-b755-4504-b002-f9739aa210df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ea8b5-3068-477f-9885-4fdee03d5700", "address": "fa:16:3e:73:ac:26", "network": {"id": "ba5943d7-0e36-4f02-b7b4-c7af36a5af1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-997680272", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "169f440a723149379e44f8fe5872e75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ea8b5-30", "ovs_interfaceid": "c14ea8b5-3068-477f-9885-4fdee03d5700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Attempting to detach device vdb from instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:18:16 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:16 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:18:16 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:16 user nova-compute[76391]:   <serial>a7bf07ba-d34e-4abd-a7b4-11f316a99669</serial>
Nov 15 23:18:16 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:18:16 user nova-compute[76391]: </disk>
Nov 15 23:18:16 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Successfully detached device vdb from instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa from the persistent domain config.
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:18:16 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:16 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:18:16 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:16 user nova-compute[76391]:   <serial>a7bf07ba-d34e-4abd-a7b4-11f316a99669</serial>
Nov 15 23:18:16 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:18:16 user nova-compute[76391]: </disk>
Nov 15 23:18:16 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-bdedc436-3972-47ac-86a2-9bdcd62a3c05 req-3b3983cf-d867-45ef-b31e-46b8031aac3e service nova] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Detach interface failed, port_id=0303a44c-9762-420c-bd6b-d9cacd015e7f, reason: Instance 737991f4-b661-45db-84ba-53dbb2dce7dc could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-0a62a50d-c9e6-45f6-b746-0ad789b64f44 req-9863bb5c-01ad-45ab-a517-6451cb8c844c service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0a62a50d-c9e6-45f6-b746-0ad789b64f44 req-9863bb5c-01ad-45ab-a517-6451cb8c844c service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0a62a50d-c9e6-45f6-b746-0ad789b64f44 req-9863bb5c-01ad-45ab-a517-6451cb8c844c service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0a62a50d-c9e6-45f6-b746-0ad789b64f44 req-9863bb5c-01ad-45ab-a517-6451cb8c844c service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-0a62a50d-c9e6-45f6-b746-0ad789b64f44 req-9863bb5c-01ad-45ab-a517-6451cb8c844c service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:16 user nova-compute[76391]: WARNING nova.compute.manager [req-0a62a50d-c9e6-45f6-b746-0ad789b64f44 req-9863bb5c-01ad-45ab-a517-6451cb8c844c service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received unexpected event network-vif-plugged-1cfba799-5f77-44cb-a9b5-86902b7456e4 for instance with vm_state active and task_state None.
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:16 user nova-compute[76391]: INFO nova.compute.manager [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] [instance: 091f63e7-0384-434c-be37-804b10e051fb] Took 2.92 seconds to detach 3 volumes for instance.
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:17 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Deleted allocations for instance 091f63e7-0384-434c-be37-804b10e051fb
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-45b5f9cc-d35f-406a-9e97-01e18aed25e8 tempest-TaggedBootDevicesTest-1775805296 tempest-TaggedBootDevicesTest-1775805296-project-member] Lock "091f63e7-0384-434c-be37-804b10e051fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.558s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:18:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=25.44491195678711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance eb286b41-55ed-4a38-8e66-6edb5f0ccd0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a928dcdd-b214-4e5f-84e5-76633d313e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 737991f4-b661-45db-84ba-53dbb2dce7dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:18:18 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:18:19 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:18:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:19 user nova-compute[76391]: INFO nova.compute.manager [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] [instance: 737991f4-b661-45db-84ba-53dbb2dce7dc] Took 3.13 seconds to detach 3 volumes for instance.
Nov 15 23:18:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:19 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:18:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:18:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:19 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Deleted allocations for instance 737991f4-b661-45db-84ba-53dbb2dce7dc
Nov 15 23:18:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:18:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:18:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f5df34c1-7968-4f70-9c27-87e62d2cd86d tempest-TaggedBootDevicesTest_v242-1419769492 tempest-TaggedBootDevicesTest_v242-1419769492-project-member] Lock "737991f4-b661-45db-84ba-53dbb2dce7dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.785s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 is timed out.
Nov 15 23:18:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Successfully detached device vdb from instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 from the live domain config.
Nov 15 23:18:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdnaxop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:27 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97de1d0-c7b8-4dfa-9877-d66c8c633193]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:27 user nova-compute[76391]: No targets found.
Nov 15 23:18:27 user nova-compute[76391]: iSNS:
Nov 15 23:18:27 user nova-compute[76391]: No targets found.
Nov 15 23:18:27 user nova-compute[76391]: STATIC:
Nov 15 23:18:27 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5
Nov 15 23:18:27 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:27 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:27 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:27 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:27 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:27 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:27 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:27 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:27 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:27 user nova-compute[76391]: No targets found.
Nov 15 23:18:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:27 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:27 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8caf0b-49a7-495b-8f7e-8bf10a1987d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d738a07-6246-4fc1-8c2b-b61dda42e4a4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:27 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:27 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 (non-flash)
Nov 15 23:18:27 user nova-compute[76391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:27 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976d4dfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[995df511-8b2a-499a-8b14-88da99e38297]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48b3a34-596b-4453-94c6-8396323787da]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a1229c-37e0-4e59-8795-439b8fb43b58]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f520a71-531f-43dd-964b-5a806647d110]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc16ffe-84ae-4654-bd36-e6b22011c9d5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c8a690-9695-4dff-b5ff-8b9fc6823556]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260]
Nov 15 23:18:27 user nova-compute[76391]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fafc3e88-4847-4dbe-8d54-c8c81ffd2df5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[012acd05-8570-4333-835e-f10ab315bd67]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] <== disconnect_volume: return (289ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:28 user nova-compute[76391]: DEBUG nova.objects.instance [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lazy-loading 'flavor' on Instance uuid 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81594593-a0fa-4a98-80e9-ff16ba5af2e8 tempest-VolumesAssistedSnapshotsTest-673282777 tempest-VolumesAssistedSnapshotsTest-673282777-project-admin] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:18:32 user nova-compute[76391]: INFO nova.compute.claims [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Claim successful on node user
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-changed-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Refreshing instance network info cache due to event network-changed-2a59c58d-9ce8-4450-9287-d8605f63d82b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] Acquiring lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] Acquired lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.network.neutron [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Refreshing network info cache for port 2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:18:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:18:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Creating image(s)
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "/opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "/opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:32 user nova-compute[76391]: DEBUG nova.policy [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a69f501c85d14ba9a335d49127b2e534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36a5adda4e479884daa83ddb23d9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.166s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk 1073741824" returned: 0 in 0.048s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Updated VIF entry in instance network info cache for port 2a59c58d-9ce8-4450-9287-d8605f63d82b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Updating instance_info_cache with network_info: [{"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-004d045f-b010-4bc0-afd4-3696c5e43476 req-dd91cb5c-1572-4567-b917-8b800f73f046 service nova] Releasing lock "refresh_cache-0e649109-ec27-45b9-93ca-ee6bddf5d0d8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Cannot resize image /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Ensure instance console log exists: /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Successfully created port: c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Successfully updated port: c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "refresh_cache-ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquired lock "refresh_cache-ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:18:34 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Waiting for libvirt event about the detach of device tap1cfba799-5f with device alias net1 from instance a928dcdd-b214-4e5f-84e5-76633d313e4b is timed out.
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e1:86:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap1cfba799-5f"/></interface> {{(pid=76391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e1:86:34"/><model type="virtio"/><mtu size="1442"/><target dev="tap1cfba799-5f"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 15 23:18:34 user nova-compute[76391]:   <name>instance-00000007</name>
Nov 15 23:18:34 user nova-compute[76391]:   <uuid>a928dcdd-b214-4e5f-84e5-76633d313e4b</uuid>
Nov 15 23:18:34 user nova-compute[76391]:   <metadata>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:18:34 user nova-compute[76391]:   <nova:package version="0.0.0"/>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:name>tempest-device-tagging-server-392690336</nova:name>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:creationTime>2023-11-15 23:17:41</nova:creationTime>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:flavor name="m1.tiny">
Nov 15 23:18:34 user nova-compute[76391]:     <nova:memory>512</nova:memory>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:disk>1</nova:disk>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:swap>0</nova:swap>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 23:18:34 user nova-compute[76391]:   </nova:flavor>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:owner>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:user uuid="538446003d4147a586ba8675a3fbef81">tempest-TaggedAttachmentsTest-1986589477-project-member</nova:user>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:project uuid="e14a7df237f84c518de0804a57254975">tempest-TaggedAttachmentsTest-1986589477</nova:project>
Nov 15 23:18:34 user nova-compute[76391]:   </nova:owner>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:ports>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:port uuid="9722bca6-f5a9-46c2-81ab-f50b88433b28">
Nov 15 23:18:34 user nova-compute[76391]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:18:34 user nova-compute[76391]:     </nova:port>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:port uuid="1cfba799-5f77-44cb-a9b5-86902b7456e4">
Nov 15 23:18:34 user nova-compute[76391]:       <nova:ip type="fixed" address="10.10.10.149" ipVersion="4"/>
Nov 15 23:18:34 user nova-compute[76391]:     </nova:port>
Nov 15 23:18:34 user nova-compute[76391]:   </nova:ports>
Nov 15 23:18:34 user nova-compute[76391]: </nova:instance>
Nov 15 23:18:34 user nova-compute[76391]:   </metadata>
Nov 15 23:18:34 user nova-compute[76391]:   <memory unit='KiB'>524288</memory>
Nov 15 23:18:34 user nova-compute[76391]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 23:18:34 user nova-compute[76391]:   <vcpu placement='static'>1</vcpu>
Nov 15 23:18:34 user nova-compute[76391]:   <resource>
Nov 15 23:18:34 user nova-compute[76391]:     <partition>/machine</partition>
Nov 15 23:18:34 user nova-compute[76391]:   </resource>
Nov 15 23:18:34 user nova-compute[76391]:   <sysinfo type='smbios'>
Nov 15 23:18:34 user nova-compute[76391]:     <system>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name='version'>0.0.0</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name='serial'>a928dcdd-b214-4e5f-84e5-76633d313e4b</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name='uuid'>a928dcdd-b214-4e5f-84e5-76633d313e4b</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name='family'>Virtual Machine</entry>
Nov 15 23:18:34 user nova-compute[76391]:     </system>
Nov 15 23:18:34 user nova-compute[76391]:   </sysinfo>
Nov 15 23:18:34 user nova-compute[76391]:   <os>
Nov 15 23:18:34 user nova-compute[76391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 23:18:34 user nova-compute[76391]:     <boot dev='hd'/>
Nov 15 23:18:34 user nova-compute[76391]:     <smbios mode='sysinfo'/>
Nov 15 23:18:34 user nova-compute[76391]:   </os>
Nov 15 23:18:34 user nova-compute[76391]:   <features>
Nov 15 23:18:34 user nova-compute[76391]:     <acpi/>
Nov 15 23:18:34 user nova-compute[76391]:     <apic/>
Nov 15 23:18:34 user nova-compute[76391]:     <vmcoreinfo state='on'/>
Nov 15 23:18:34 user nova-compute[76391]:   </features>
Nov 15 23:18:34 user nova-compute[76391]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 23:18:34 user nova-compute[76391]:     <model fallback='forbid'>Nehalem</model>
Nov 15 23:18:34 user nova-compute[76391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 23:18:34 user nova-compute[76391]:     <feature policy='require' name='vme'/>
Nov 15 23:18:34 user nova-compute[76391]:     <feature policy='require' name='x2apic'/>
Nov 15 23:18:34 user nova-compute[76391]:     <feature policy='require' name='hypervisor'/>
Nov 15 23:18:34 user nova-compute[76391]:   </cpu>
Nov 15 23:18:34 user nova-compute[76391]:   <clock offset='utc'>
Nov 15 23:18:34 user nova-compute[76391]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 23:18:34 user nova-compute[76391]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 23:18:34 user nova-compute[76391]:     <timer name='hpet' present='no'/>
Nov 15 23:18:34 user nova-compute[76391]:   </clock>
Nov 15 23:18:34 user nova-compute[76391]:   <on_poweroff>destroy</on_poweroff>
Nov 15 23:18:34 user nova-compute[76391]:   <on_reboot>restart</on_reboot>
Nov 15 23:18:34 user nova-compute[76391]:   <on_crash>destroy</on_crash>
Nov 15 23:18:34 user nova-compute[76391]:   <devices>
Nov 15 23:18:34 user nova-compute[76391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 23:18:34 user nova-compute[76391]:     <disk type='file' device='disk'>
Nov 15 23:18:34 user nova-compute[76391]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 23:18:34 user nova-compute[76391]:       <source file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk' index='2'/>
Nov 15 23:18:34 user nova-compute[76391]:       <backingStore type='file' index='3'>
Nov 15 23:18:34 user nova-compute[76391]:         <format type='raw'/>
Nov 15 23:18:34 user nova-compute[76391]:         <source file='/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c'/>
Nov 15 23:18:34 user nova-compute[76391]:         <backingStore/>
Nov 15 23:18:34 user nova-compute[76391]:       </backingStore>
Nov 15 23:18:34 user nova-compute[76391]:       <target dev='vda' bus='virtio'/>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='virtio-disk0'/>
Nov 15 23:18:34 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </disk>
Nov 15 23:18:34 user nova-compute[76391]:     <disk type='file' device='cdrom'>
Nov 15 23:18:34 user nova-compute[76391]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 23:18:34 user nova-compute[76391]:       <source file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/disk.config' index='1'/>
Nov 15 23:18:34 user nova-compute[76391]:       <backingStore/>
Nov 15 23:18:34 user nova-compute[76391]:       <target dev='hda' bus='ide'/>
Nov 15 23:18:34 user nova-compute[76391]:       <readonly/>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='ide0-0-0'/>
Nov 15 23:18:34 user nova-compute[76391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </disk>
Nov 15 23:18:34 user nova-compute[76391]:     <controller type='usb' index='0' model='none'>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='usb'/>
Nov 15 23:18:34 user nova-compute[76391]:     </controller>
Nov 15 23:18:34 user nova-compute[76391]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='pci.0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </controller>
Nov 15 23:18:34 user nova-compute[76391]:     <controller type='ide' index='0'>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='ide'/>
Nov 15 23:18:34 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 23:18:34 user nova-compute[76391]:     </controller>
Nov 15 23:18:34 user nova-compute[76391]:     <interface type='ethernet'>
Nov 15 23:18:34 user nova-compute[76391]:       <mac address='fa:16:3e:fb:23:fb'/>
Nov 15 23:18:34 user nova-compute[76391]:       <target dev='tap9722bca6-f5'/>
Nov 15 23:18:34 user nova-compute[76391]:       <model type='virtio'/>
Nov 15 23:18:34 user nova-compute[76391]:       <mtu size='1442'/>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='net0'/>
Nov 15 23:18:34 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </interface>
Nov 15 23:18:34 user nova-compute[76391]:     <serial type='pty'>
Nov 15 23:18:34 user nova-compute[76391]:       <source path='/dev/pts/5'/>
Nov 15 23:18:34 user nova-compute[76391]:       <log file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/console.log' append='off'/>
Nov 15 23:18:34 user nova-compute[76391]:       <target type='isa-serial' port='0'>
Nov 15 23:18:34 user nova-compute[76391]:         <model name='isa-serial'/>
Nov 15 23:18:34 user nova-compute[76391]:       </target>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='serial0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </serial>
Nov 15 23:18:34 user nova-compute[76391]:     <console type='pty' tty='/dev/pts/5'>
Nov 15 23:18:34 user nova-compute[76391]:       <source path='/dev/pts/5'/>
Nov 15 23:18:34 user nova-compute[76391]:       <log file='/opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b/console.log' append='off'/>
Nov 15 23:18:34 user nova-compute[76391]:       <target type='serial' port='0'/>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='serial0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </console>
Nov 15 23:18:34 user nova-compute[76391]:     <input type='mouse' bus='ps2'>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='input0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </input>
Nov 15 23:18:34 user nova-compute[76391]:     <input type='keyboard' bus='ps2'>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='input1'/>
Nov 15 23:18:34 user nova-compute[76391]:     </input>
Nov 15 23:18:34 user nova-compute[76391]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 15 23:18:34 user nova-compute[76391]:       <listen type='address' address='0.0.0.0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </graphics>
Nov 15 23:18:34 user nova-compute[76391]:     <audio id='1' type='none'/>
Nov 15 23:18:34 user nova-compute[76391]:     <video>
Nov 15 23:18:34 user nova-compute[76391]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='video0'/>
Nov 15 23:18:34 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </video>
Nov 15 23:18:34 user nova-compute[76391]:     <memballoon model='virtio'>
Nov 15 23:18:34 user nova-compute[76391]:       <stats period='10'/>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='balloon0'/>
Nov 15 23:18:34 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </memballoon>
Nov 15 23:18:34 user nova-compute[76391]:     <rng model='virtio'>
Nov 15 23:18:34 user nova-compute[76391]:       <backend model='random'>/dev/urandom</backend>
Nov 15 23:18:34 user nova-compute[76391]:       <alias name='rng0'/>
Nov 15 23:18:34 user nova-compute[76391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 23:18:34 user nova-compute[76391]:     </rng>
Nov 15 23:18:34 user nova-compute[76391]:   </devices>
Nov 15 23:18:34 user nova-compute[76391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 23:18:34 user nova-compute[76391]:     <label>libvirt-a928dcdd-b214-4e5f-84e5-76633d313e4b</label>
Nov 15 23:18:34 user nova-compute[76391]:     <imagelabel>libvirt-a928dcdd-b214-4e5f-84e5-76633d313e4b</imagelabel>
Nov 15 23:18:34 user nova-compute[76391]:   </seclabel>
Nov 15 23:18:34 user nova-compute[76391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 23:18:34 user nova-compute[76391]:     <label>+64055:+108</label>
Nov 15 23:18:34 user nova-compute[76391]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 23:18:34 user nova-compute[76391]:   </seclabel>
Nov 15 23:18:34 user nova-compute[76391]: </domain>
Nov 15 23:18:34 user nova-compute[76391]:  {{(pid=76391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 23:18:34 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully detached device tap1cfba799-5f from instance a928dcdd-b214-4e5f-84e5-76633d313e4b from the live domain config.
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392690336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392690336',id=7,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0IspOOwh4AxJxavAWXMIXxyzIMrl5nEywXM3UCkaIXrQ4id+z3X0cGmiwOi/O0sqc9uZ5aEcv3TENtVTyqVPRYbiCBkzRNPUHJ+VUjOn4PSSiaFmNQVRgZ33uNsYuXlQ==',key_name='tempest-keypair-210828776',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e14a7df237f84c518de0804a57254975',ramdisk_id='',reservation_id='r-kti4w7p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986589477',owner_user_name='tempest-TaggedAttachmentsTest-1986589477-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538446003d4147a586ba8675a3fbef81',uuid=a928dcdd-b214-4e5f-84e5-76633d313e4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converting VIF {"id": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "address": "fa:16:3e:e1:86:34", "network": {"id": "428bf012-b52e-4e64-a204-20fed2cfbed7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-21778427", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfba799-5f", "ovs_interfaceid": "1cfba799-5f77-44cb-a9b5-86902b7456e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG os_vif [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cfba799-5f, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f937977-9682-4494-9252-4f955506e5ca) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:34 user nova-compute[76391]: INFO os_vif [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:86:34,bridge_name='br-int',has_traffic_filtering=True,id=1cfba799-5f77-44cb-a9b5-86902b7456e4,network=Network(428bf012-b52e-4e64-a204-20fed2cfbed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfba799-5f')
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:18:34 user nova-compute[76391]:   <nova:package version="0.0.0"/>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:name>tempest-device-tagging-server-392690336</nova:name>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:creationTime>2023-11-15 23:18:34</nova:creationTime>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:flavor name="m1.tiny">
Nov 15 23:18:34 user nova-compute[76391]:     <nova:memory>512</nova:memory>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:disk>1</nova:disk>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:swap>0</nova:swap>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 23:18:34 user nova-compute[76391]:   </nova:flavor>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:owner>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:user uuid="538446003d4147a586ba8675a3fbef81">tempest-TaggedAttachmentsTest-1986589477-project-member</nova:user>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:project uuid="e14a7df237f84c518de0804a57254975">tempest-TaggedAttachmentsTest-1986589477</nova:project>
Nov 15 23:18:34 user nova-compute[76391]:   </nova:owner>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:18:34 user nova-compute[76391]:   <nova:ports>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:port uuid="9722bca6-f5a9-46c2-81ab-f50b88433b28">
Nov 15 23:18:34 user nova-compute[76391]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:18:34 user nova-compute[76391]:     </nova:port>
Nov 15 23:18:34 user nova-compute[76391]:   </nova:ports>
Nov 15 23:18:34 user nova-compute[76391]: </nova:instance>
Nov 15 23:18:34 user nova-compute[76391]:  {{(pid=76391) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received event network-changed-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Refreshing instance network info cache due to event network-changed-c051e8bd-3bf8-4286-9394-7235ff5b47ac. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] Acquiring lock "refresh_cache-ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Updating instance_info_cache with network_info: [{"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Releasing lock "refresh_cache-ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Instance network_info: |[{"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] Acquired lock "refresh_cache-ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Refreshing network info cache for port c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Start _get_guest_xml network_info=[{"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:18:34 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:18:34 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-102435708',display_name='tempest-VolumesAdminNegativeTest-server-102435708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-102435708',id=13,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36a5adda4e479884daa83ddb23d9da',ramdisk_id='',reservation_id='r-0vnwzon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2137202579',owner_user_name='tempest-VolumesAdminNegativeTest-2137202579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:18:33Z,user_data=None,user_id='a69f501c85d14ba9a335d49127b2e534',uuid=ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converting VIF {"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fa:da,bridge_name='br-int',has_traffic_filtering=True,id=c051e8bd-3bf8-4286-9394-7235ff5b47ac,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e8bd-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lazy-loading 'pci_devices' on Instance uuid ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:18:34 user nova-compute[76391]: INFO nova.compute.claims [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Claim successful on node user
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:18:34 user nova-compute[76391]:   <uuid>ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11</uuid>
Nov 15 23:18:34 user nova-compute[76391]:   <name>instance-0000000d</name>
Nov 15 23:18:34 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:18:34 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:18:34 user nova-compute[76391]:   <metadata>
Nov 15 23:18:34 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:18:34 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:18:34 user nova-compute[76391]:       <nova:name>tempest-VolumesAdminNegativeTest-server-102435708</nova:name>
Nov 15 23:18:34 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:18:34</nova:creationTime>
Nov 15 23:18:34 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:18:34 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:18:34 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:18:34 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:18:34 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:18:34 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:18:34 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:18:34 user nova-compute[76391]:       <nova:owner>
Nov 15 23:18:34 user nova-compute[76391]:         <nova:user uuid="a69f501c85d14ba9a335d49127b2e534">tempest-VolumesAdminNegativeTest-2137202579-project-member</nova:user>
Nov 15 23:18:34 user nova-compute[76391]:         <nova:project uuid="5d36a5adda4e479884daa83ddb23d9da">tempest-VolumesAdminNegativeTest-2137202579</nova:project>
Nov 15 23:18:34 user nova-compute[76391]:       </nova:owner>
Nov 15 23:18:34 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:18:34 user nova-compute[76391]:       <nova:ports>
Nov 15 23:18:34 user nova-compute[76391]:         <nova:port uuid="c051e8bd-3bf8-4286-9394-7235ff5b47ac">
Nov 15 23:18:34 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 23:18:34 user nova-compute[76391]:         </nova:port>
Nov 15 23:18:34 user nova-compute[76391]:       </nova:ports>
Nov 15 23:18:34 user nova-compute[76391]:     </nova:instance>
Nov 15 23:18:34 user nova-compute[76391]:   </metadata>
Nov 15 23:18:34 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:18:34 user nova-compute[76391]:     <system>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name="serial">ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name="uuid">ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11</entry>
Nov 15 23:18:34 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:18:34 user nova-compute[76391]:     </system>
Nov 15 23:18:34 user nova-compute[76391]:   </sysinfo>
Nov 15 23:18:34 user nova-compute[76391]:   <os>
Nov 15 23:18:34 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:18:34 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:18:34 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:18:34 user nova-compute[76391]:   </os>
Nov 15 23:18:34 user nova-compute[76391]:   <features>
Nov 15 23:18:34 user nova-compute[76391]:     <acpi/>
Nov 15 23:18:34 user nova-compute[76391]:     <apic/>
Nov 15 23:18:34 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:18:34 user nova-compute[76391]:   </features>
Nov 15 23:18:34 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:18:34 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:18:34 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:18:34 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:18:34 user nova-compute[76391]:   </clock>
Nov 15 23:18:34 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:18:34 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:18:34 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:18:34 user nova-compute[76391]:   </cpu>
Nov 15 23:18:34 user nova-compute[76391]:   <devices>
Nov 15 23:18:34 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:18:34 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:18:34 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk"/>
Nov 15 23:18:34 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:18:34 user nova-compute[76391]:     </disk>
Nov 15 23:18:34 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:18:34 user nova-compute[76391]:       <mac address="fa:16:3e:3d:fa:da"/>
Nov 15 23:18:34 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:18:34 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:18:34 user nova-compute[76391]:       <target dev="tapc051e8bd-3b"/>
Nov 15 23:18:34 user nova-compute[76391]:     </interface>
Nov 15 23:18:34 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:18:34 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/console.log" append="off"/>
Nov 15 23:18:34 user nova-compute[76391]:     </serial>
Nov 15 23:18:34 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:18:34 user nova-compute[76391]:     <video>
Nov 15 23:18:34 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:18:34 user nova-compute[76391]:     </video>
Nov 15 23:18:34 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:18:34 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:18:34 user nova-compute[76391]:     </rng>
Nov 15 23:18:34 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:18:34 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:18:34 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:18:34 user nova-compute[76391]:     </memballoon>
Nov 15 23:18:34 user nova-compute[76391]:   </devices>
Nov 15 23:18:34 user nova-compute[76391]: </domain>
Nov 15 23:18:34 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-102435708',display_name='tempest-VolumesAdminNegativeTest-server-102435708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-102435708',id=13,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36a5adda4e479884daa83ddb23d9da',ramdisk_id='',reservation_id='r-0vnwzon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2137202579',owner_user_name='tempest-VolumesAdminNegativeTest-2137202579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:18:33Z,user_data=None,user_id='a69f501c85d14ba9a335d49127b2e534',uuid=ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converting VIF {"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fa:da,bridge_name='br-int',has_traffic_filtering=True,id=c051e8bd-3bf8-4286-9394-7235ff5b47ac,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e8bd-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG os_vif [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fa:da,bridge_name='br-int',has_traffic_filtering=True,id=c051e8bd-3bf8-4286-9394-7235ff5b47ac,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e8bd-3b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62b7c039-b9d4-5c8b-b9b7-0b4c47687404', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc051e8bd-3b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc051e8bd-3b, col_values=(('qos', UUID('4c50ffef-8a43-4924-abdc-2449a973b922')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc051e8bd-3b, col_values=(('external_ids', {'iface-id': 'c051e8bd-3bf8-4286-9394-7235ff5b47ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:fa:da', 'vm-uuid': 'ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:35 user nova-compute[76391]: INFO os_vif [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fa:da,bridge_name='br-int',has_traffic_filtering=True,id=c051e8bd-3bf8-4286-9394-7235ff5b47ac,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e8bd-3b')
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] No VIF found with MAC fa:16:3e:3d:fa:da, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquired lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Updated VIF entry in instance network info cache for port c051e8bd-3bf8-4286-9394-7235ff5b47ac. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Updating instance_info_cache with network_info: [{"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc144222-adf3-481b-b28e-a70e955975d6 req-9637dcf1-f761-4711-bfe6-fb966ac11402 service nova] Releasing lock "refresh_cache-ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.network.neutron [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:18:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.policy [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2af794740660401081cf6d7e38289bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5841417a1d4439c8059c788533b08b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:18:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Creating image(s)
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "/opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "/opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.objects.instance [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lazy-loading 'flavor' on Instance uuid 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:35 user nova-compute[76391]: INFO nova.network.neutron [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Port 1cfba799-5f77-44cb-a9b5-86902b7456e4 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 15 23:18:35 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating instance_info_cache with network_info: [{"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Releasing lock "refresh_cache-a928dcdd-b214-4e5f-84e5-76633d313e4b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e43dc3ea-c51c-41a0-9def-327b1bfc4c80 tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "interface-a928dcdd-b214-4e5f-84e5-76633d313e4b-1cfba799-5f77-44cb-a9b5-86902b7456e4" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:35 user nova-compute[76391]: INFO nova.compute.manager [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Attaching volume f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 to /dev/vdb
Nov 15 23:18:36 user nova-compute[76391]: DEBUG os_brick.utils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ba36f3-46b3-454e-bcd1-beeb9daffb81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.201s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb466e-2191-4b97-86b8-7e0951f41909]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk 1073741824" returned: 0 in 0.057s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b8c44-f9c7-4d34-8e8b-6638a1d442cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4688fe-cc24-4e89-8f73-7f7d2d3e520e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:18:36 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89bf171-2bdc-4f47-b0ab-670c81f2a1ad]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG os_brick.utils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Updating existing volume attachment record: 680a4f6f-d9da-444e-ba2b-06324fde2222 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG nova.network.neutron [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Successfully created port: 3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Cannot resize image /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Ensure instance console log exists: /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:36 user nova-compute[76391]: DEBUG nova.compute.manager [req-b80bc2bf-5051-4d58-bafe-532a777e18a6 req-1bdd2ece-98d5-4671-9eb3-3f0b551ec041 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-deleted-1cfba799-5f77-44cb-a9b5-86902b7456e4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Successfully updated port: 3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "refresh_cache-4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquired lock "refresh_cache-4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:18:37 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa is timed out.
Nov 15 23:18:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Successfully detached device vdb from instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa from the live domain config.
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaZXSthk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'a7bf07ba-d34e-4abd-a7b4-11f316a99669'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:37 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7bc6a3-0217-49c5-9524-c52eb5fd3238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:18:37 user nova-compute[76391]: No targets found.
Nov 15 23:18:37 user nova-compute[76391]: iSNS:
Nov 15 23:18:37 user nova-compute[76391]: No targets found.
Nov 15 23:18:37 user nova-compute[76391]: STATIC:
Nov 15 23:18:37 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:18:37 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:37 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:37 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669
Nov 15 23:18:37 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:18:37 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:18:37 user nova-compute[76391]: FIRMWARE:
Nov 15 23:18:37 user nova-compute[76391]: No targets found.
Nov 15 23:18:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:18:37 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:18:37 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[961ce5df-7abe-46f9-8d29-d57d17534dd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bfda12-84c7-48a2-9327-bd0f1b5e4929]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:37 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:37 user nova-compute[76391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 (non-flash)
Nov 15 23:18:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405cb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669'): ({'sde'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Removing single pathed devices sde {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2009020-1a8f-474f-9b52-530b81d586e5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[591f5a12-a1b9-4c24-9752-67f19708b0ff]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Flushing IO for device /dev/sde {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1dd97f-4c98-4233-a19b-52427ef601a1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76008c49-63ec-4185-9321-dcafc332c39d]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a3c55-baf2-40a1-a4d9-8491ba0d96b7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60aeac7-5c53-4de9-b269-5f299556ec21]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260]
Nov 15 23:18:37 user nova-compute[76391]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7bf07ba-d34e-4abd-a7b4-11f316a99669 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd4801-f8b6-4e9d-9167-2f15bb55fad4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] <== disconnect_volume: return (319ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Updating instance_info_cache with network_info: [{"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Releasing lock "refresh_cache-4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Instance network_info: |[{"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Start _get_guest_xml network_info=[{"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:18:37 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:18:37 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2110278607',display_name='tempest-VolumesActionsTest-instance-2110278607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2110278607',id=14,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5841417a1d4439c8059c788533b08b9',ramdisk_id='',reservation_id='r-c38j09ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1618594309',owner_user_name='tempest-VolumesActionsTest-1618594309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:18:36Z,user_data=None,user_id='2af794740660401081cf6d7e38289bd0',uuid=4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converting VIF {"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=3917e5e4-7891-45d1-b015-20127d3fe142,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3917e5e4-78') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.objects.instance [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:18:37 user nova-compute[76391]:   <uuid>4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3</uuid>
Nov 15 23:18:37 user nova-compute[76391]:   <name>instance-0000000e</name>
Nov 15 23:18:37 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:18:37 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:18:37 user nova-compute[76391]:   <metadata>
Nov 15 23:18:37 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:18:37 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:18:37 user nova-compute[76391]:       <nova:name>tempest-VolumesActionsTest-instance-2110278607</nova:name>
Nov 15 23:18:37 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:18:37</nova:creationTime>
Nov 15 23:18:37 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:18:37 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:18:37 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:18:37 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:18:37 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:18:37 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:18:37 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:18:37 user nova-compute[76391]:       <nova:owner>
Nov 15 23:18:37 user nova-compute[76391]:         <nova:user uuid="2af794740660401081cf6d7e38289bd0">tempest-VolumesActionsTest-1618594309-project-member</nova:user>
Nov 15 23:18:37 user nova-compute[76391]:         <nova:project uuid="b5841417a1d4439c8059c788533b08b9">tempest-VolumesActionsTest-1618594309</nova:project>
Nov 15 23:18:37 user nova-compute[76391]:       </nova:owner>
Nov 15 23:18:37 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:18:37 user nova-compute[76391]:       <nova:ports>
Nov 15 23:18:37 user nova-compute[76391]:         <nova:port uuid="3917e5e4-7891-45d1-b015-20127d3fe142">
Nov 15 23:18:37 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 23:18:37 user nova-compute[76391]:         </nova:port>
Nov 15 23:18:37 user nova-compute[76391]:       </nova:ports>
Nov 15 23:18:37 user nova-compute[76391]:     </nova:instance>
Nov 15 23:18:37 user nova-compute[76391]:   </metadata>
Nov 15 23:18:37 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:18:37 user nova-compute[76391]:     <system>
Nov 15 23:18:37 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:18:37 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:18:37 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:18:37 user nova-compute[76391]:       <entry name="serial">4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3</entry>
Nov 15 23:18:37 user nova-compute[76391]:       <entry name="uuid">4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3</entry>
Nov 15 23:18:37 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:18:37 user nova-compute[76391]:     </system>
Nov 15 23:18:37 user nova-compute[76391]:   </sysinfo>
Nov 15 23:18:37 user nova-compute[76391]:   <os>
Nov 15 23:18:37 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:18:37 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:18:37 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:18:37 user nova-compute[76391]:   </os>
Nov 15 23:18:37 user nova-compute[76391]:   <features>
Nov 15 23:18:37 user nova-compute[76391]:     <acpi/>
Nov 15 23:18:37 user nova-compute[76391]:     <apic/>
Nov 15 23:18:37 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:18:37 user nova-compute[76391]:   </features>
Nov 15 23:18:37 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:18:37 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:18:37 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:18:37 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:18:37 user nova-compute[76391]:   </clock>
Nov 15 23:18:37 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:18:37 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:18:37 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:18:37 user nova-compute[76391]:   </cpu>
Nov 15 23:18:37 user nova-compute[76391]:   <devices>
Nov 15 23:18:37 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:18:37 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:18:37 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk"/>
Nov 15 23:18:37 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:18:37 user nova-compute[76391]:     </disk>
Nov 15 23:18:37 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:18:37 user nova-compute[76391]:       <mac address="fa:16:3e:ed:29:cd"/>
Nov 15 23:18:37 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:18:37 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:18:37 user nova-compute[76391]:       <target dev="tap3917e5e4-78"/>
Nov 15 23:18:37 user nova-compute[76391]:     </interface>
Nov 15 23:18:37 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:18:37 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/console.log" append="off"/>
Nov 15 23:18:37 user nova-compute[76391]:     </serial>
Nov 15 23:18:37 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:18:37 user nova-compute[76391]:     <video>
Nov 15 23:18:37 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:18:37 user nova-compute[76391]:     </video>
Nov 15 23:18:37 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:18:37 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:18:37 user nova-compute[76391]:     </rng>
Nov 15 23:18:37 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:18:37 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:18:37 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:18:37 user nova-compute[76391]:     </memballoon>
Nov 15 23:18:37 user nova-compute[76391]:   </devices>
Nov 15 23:18:37 user nova-compute[76391]: </domain>
Nov 15 23:18:37 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2110278607',display_name='tempest-VolumesActionsTest-instance-2110278607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2110278607',id=14,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5841417a1d4439c8059c788533b08b9',ramdisk_id='',reservation_id='r-c38j09ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1618594309',owner_user_name='tempest-VolumesActionsTest-1618594309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:18:36Z,user_data=None,user_id='2af794740660401081cf6d7e38289bd0',uuid=4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converting VIF {"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=3917e5e4-7891-45d1-b015-20127d3fe142,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3917e5e4-78') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG os_vif [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=3917e5e4-7891-45d1-b015-20127d3fe142,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3917e5e4-78') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f71f9de-b213-5869-8587-2b041db7c79c', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3917e5e4-78, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3917e5e4-78, col_values=(('qos', UUID('8d681900-a01e-4782-8777-dc8a8cff4faf')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3917e5e4-78, col_values=(('external_ids', {'iface-id': '3917e5e4-7891-45d1-b015-20127d3fe142', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:29:cd', 'vm-uuid': '4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:37 user nova-compute[76391]: INFO os_vif [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=3917e5e4-7891-45d1-b015-20127d3fe142,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3917e5e4-78')
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:18:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] No VIF found with MAC fa:16:3e:ed:29:cd, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lazy-loading 'flavor' on Instance uuid cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9b09a883-581c-47ef-9eaf-1cdc59f60566 tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.986s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received event network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Acquiring lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] No waiting events found dispatching network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:38 user nova-compute[76391]: WARNING nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received unexpected event network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac for instance with vm_state building and task_state spawning.
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received event network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Acquiring lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] No waiting events found dispatching network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:38 user nova-compute[76391]: WARNING nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received unexpected event network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac for instance with vm_state building and task_state spawning.
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received event network-changed-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Refreshing instance network info cache due to event network-changed-3917e5e4-7891-45d1-b015-20127d3fe142. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Acquiring lock "refresh_cache-4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Acquired lock "refresh_cache-4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.network.neutron [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Refreshing network info cache for port 3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:18:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Instance spawned successfully.
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:38 user nova-compute[76391]: INFO nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 15 23:18:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:18:38 user nova-compute[76391]: INFO nova.compute.manager [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Took 6.85 seconds to build instance.
Nov 15 23:18:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c8ec2720-05dd-4202-8301-957f528ba1fb tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.016s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Updated VIF entry in instance network info cache for port 3917e5e4-7891-45d1-b015-20127d3fe142. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Updating instance_info_cache with network_info: [{"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57f01293-ce40-4578-91bf-537326d73f7e req-fce3ccaa-05c6-42f7-abc7-e4466212efc1 service nova] Releasing lock "refresh_cache-4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-5bcc12f3-5ad6-4592-bb10-75ea27bdd637 req-5e229923-95a9-4905-8cc5-d24015a5be39 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received event network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5bcc12f3-5ad6-4592-bb10-75ea27bdd637 req-5e229923-95a9-4905-8cc5-d24015a5be39 service nova] Acquiring lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5bcc12f3-5ad6-4592-bb10-75ea27bdd637 req-5e229923-95a9-4905-8cc5-d24015a5be39 service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5bcc12f3-5ad6-4592-bb10-75ea27bdd637 req-5e229923-95a9-4905-8cc5-d24015a5be39 service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-5bcc12f3-5ad6-4592-bb10-75ea27bdd637 req-5e229923-95a9-4905-8cc5-d24015a5be39 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] No waiting events found dispatching network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:39 user nova-compute[76391]: WARNING nova.compute.manager [req-5bcc12f3-5ad6-4592-bb10-75ea27bdd637 req-5e229923-95a9-4905-8cc5-d24015a5be39 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received unexpected event network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 for instance with vm_state building and task_state spawning.
Nov 15 23:18:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuJipFOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:18:41 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:41 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:18:41 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecca64c1-83fc-4628-9b31-59a8991e3ec4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:18:41 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe45d0be-6afc-4d96-90d1-082d3bf47e53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518] added
Nov 15 23:18:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[411de899-1d60-4f1b-89b4-5597809ffbe0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1ccab8-16c1-4185-8070-06e1985d17f8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wuJipFOK {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wuJipFOK" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8ae316-385d-4e04-8cb2-618eb057ed97]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wuJipFOK'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa0fe89-a7cd-4b39-9566-4997c58b62ab]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc411f-54d0-47f8-b5b4-a895cb958e5d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b99964-40da-4962-9fd5-525b7f642588]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260]
Nov 15 23:18:41 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260] successful.
Nov 15 23:18:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea2f1bf-137b-4920-a90f-352036c73f47]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb0167a-4a8a-4b3b-a40d-4b584247b934]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:41 user nova-compute[76391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 (non-flash)
Nov 15 23:18:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:18:41 user nova-compute[76391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 (non-flash)
Nov 15 23:18:41 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b50bda-57f3-4be9-a6d2-f5125d131622]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuJipFOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:18:41 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Instance spawned successfully.
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cde0f2c-9609-440d-8dd9-3bdbd9dbe179 req-42271102-0c8f-4e32-9743-ccddaddba428 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received event network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cde0f2c-9609-440d-8dd9-3bdbd9dbe179 req-42271102-0c8f-4e32-9743-ccddaddba428 service nova] Acquiring lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cde0f2c-9609-440d-8dd9-3bdbd9dbe179 req-42271102-0c8f-4e32-9743-ccddaddba428 service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cde0f2c-9609-440d-8dd9-3bdbd9dbe179 req-42271102-0c8f-4e32-9743-ccddaddba428 service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cde0f2c-9609-440d-8dd9-3bdbd9dbe179 req-42271102-0c8f-4e32-9743-ccddaddba428 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] No waiting events found dispatching network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:41 user nova-compute[76391]: WARNING nova.compute.manager [req-4cde0f2c-9609-440d-8dd9-3bdbd9dbe179 req-42271102-0c8f-4e32-9743-ccddaddba428 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received unexpected event network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 for instance with vm_state building and task_state spawning.
Nov 15 23:18:41 user nova-compute[76391]: INFO nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 15 23:18:41 user nova-compute[76391]: DEBUG nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:18:41 user nova-compute[76391]: INFO nova.compute.manager [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Took 6.99 seconds to build instance.
Nov 15 23:18:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edd9c55e-cc59-4573-9dfc-f66fdbc555eb tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.084s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:18:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26635653537613031', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:18:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635653537613031', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:18:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lazy-loading 'flavor' on Instance uuid 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:18:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:18:42 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:42 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:18:42 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:42 user nova-compute[76391]:   <serial>f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518</serial>
Nov 15 23:18:42 user nova-compute[76391]: </disk>
Nov 15 23:18:42 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:18:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:18:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:18:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] No VIF found with MAC fa:16:3e:0b:a2:8e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:18:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-58086c68-2dc5-4339-9813-bc4ee752cbc1 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.269s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:45 user nova-compute[76391]: INFO nova.compute.manager [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Detaching volume f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518
Nov 15 23:18:45 user nova-compute[76391]: INFO nova.virt.block_device [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Attempting to driver detach volume f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 from mountpoint /dev/vdb
Nov 15 23:18:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Attempting to detach device vdb from instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:18:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:18:45 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:45 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:18:45 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:45 user nova-compute[76391]:   <serial>f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518</serial>
Nov 15 23:18:45 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:18:45 user nova-compute[76391]: </disk>
Nov 15 23:18:45 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:45 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Successfully detached device vdb from instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 from the persistent domain config.
Nov 15 23:18:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:18:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:18:45 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:18:45 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:18:45 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:18:45 user nova-compute[76391]:   <serial>f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518</serial>
Nov 15 23:18:45 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:18:45 user nova-compute[76391]: </disk>
Nov 15 23:18:45 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:18:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:18:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:59 user nova-compute[76391]: INFO nova.compute.manager [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Terminating instance
Nov 15 23:18:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-eecb08f3-878a-42ea-9737-3a33ee47e5cd req-5b4d0991-5dd5-41a2-9be6-6a430b19bb38 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-vif-unplugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-eecb08f3-878a-42ea-9737-3a33ee47e5cd req-5b4d0991-5dd5-41a2-9be6-6a430b19bb38 service nova] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-eecb08f3-878a-42ea-9737-3a33ee47e5cd req-5b4d0991-5dd5-41a2-9be6-6a430b19bb38 service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-eecb08f3-878a-42ea-9737-3a33ee47e5cd req-5b4d0991-5dd5-41a2-9be6-6a430b19bb38 service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-eecb08f3-878a-42ea-9737-3a33ee47e5cd req-5b4d0991-5dd5-41a2-9be6-6a430b19bb38 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] No waiting events found dispatching network-vif-unplugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:18:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-eecb08f3-878a-42ea-9737-3a33ee47e5cd req-5b4d0991-5dd5-41a2-9be6-6a430b19bb38 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-vif-unplugged-8be279d3-1083-450b-837f-9fab64339e5d for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Instance destroyed successfully.
Nov 15 23:19:00 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lazy-loading 'resources' on Instance uuid 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-344974005',display_name='tempest-VolumesAssistedSnapshotsTest-server-344974005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-344974005',id=9,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKYI8HVfvy9KCxdeUNVJKHDok14HTpr5zkDyea3vEgio6yN4TRJB/XrtGS3eaeufsQdtHOqZRukhnFkAUFi6z6BfHT4K1x8GA4YQmqzeZlbskhW/NbSODm8jmyLecXcPA==',key_name='tempest-keypair-1334195819',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1bca28b2b2248218eacc56f3a4bfc07',ramdisk_id='',reservation_id='r-gidqel70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1818210341',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1818210341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40af3c78ecbc4f95baf527a9b2e47108',uuid=9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Converting VIF {"id": "8be279d3-1083-450b-837f-9fab64339e5d", "address": "fa:16:3e:df:f1:57", "network": {"id": "2bbbade9-5b8e-4420-9753-6142ba8400a2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1321671608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bca28b2b2248218eacc56f3a4bfc07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be279d3-10", "ovs_interfaceid": "8be279d3-1083-450b-837f-9fab64339e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:f1:57,bridge_name='br-int',has_traffic_filtering=True,id=8be279d3-1083-450b-837f-9fab64339e5d,network=Network(2bbbade9-5b8e-4420-9753-6142ba8400a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be279d3-10') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG os_vif [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:f1:57,bridge_name='br-int',has_traffic_filtering=True,id=8be279d3-1083-450b-837f-9fab64339e5d,network=Network(2bbbade9-5b8e-4420-9753-6142ba8400a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be279d3-10') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8be279d3-10, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=895531ed-eca3-453f-b239-d6066ad1d97d) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:00 user nova-compute[76391]: INFO os_vif [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:f1:57,bridge_name='br-int',has_traffic_filtering=True,id=8be279d3-1083-450b-837f-9fab64339e5d,network=Network(2bbbade9-5b8e-4420-9753-6142ba8400a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be279d3-10')
Nov 15 23:19:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Deleting instance files /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4_del
Nov 15 23:19:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Deletion of /opt/stack/data/nova/instances/9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4_del complete
Nov 15 23:19:00 user nova-compute[76391]: INFO nova.compute.manager [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 23:19:00 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:19:00 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:01 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Took 1.30 seconds to deallocate network for instance.
Nov 15 23:19:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-1d018a83-d5e8-4e23-81fe-644e86a2c00d req-31031d22-dab5-4b82-b869-24cc0483c78d service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-vif-deleted-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-91e7ab44-715b-4fbc-b0fe-eaf845011a28 req-86689e24-19ca-40a1-a3f2-d7687617b798 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received event network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91e7ab44-715b-4fbc-b0fe-eaf845011a28 req-86689e24-19ca-40a1-a3f2-d7687617b798 service nova] Acquiring lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91e7ab44-715b-4fbc-b0fe-eaf845011a28 req-86689e24-19ca-40a1-a3f2-d7687617b798 service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91e7ab44-715b-4fbc-b0fe-eaf845011a28 req-86689e24-19ca-40a1-a3f2-d7687617b798 service nova] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-91e7ab44-715b-4fbc-b0fe-eaf845011a28 req-86689e24-19ca-40a1-a3f2-d7687617b798 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] No waiting events found dispatching network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:01 user nova-compute[76391]: WARNING nova.compute.manager [req-91e7ab44-715b-4fbc-b0fe-eaf845011a28 req-86689e24-19ca-40a1-a3f2-d7687617b798 service nova] [instance: 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4] Received unexpected event network-vif-plugged-8be279d3-1083-450b-837f-9fab64339e5d for instance with vm_state deleted and task_state None.
Nov 15 23:19:02 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:02 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:02 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Deleted allocations for instance 9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4
Nov 15 23:19:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c02f7b34-3528-41b9-ae90-196f788e1859 tempest-VolumesAssistedSnapshotsTest-1818210341 tempest-VolumesAssistedSnapshotsTest-1818210341-project-member] Lock "9f7b6d82-9c04-4a1b-ae44-612a2a5f22a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:05 user nova-compute[76391]: INFO nova.compute.manager [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Terminating instance
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-2225f0a1-e88e-45b2-8436-e21a12eba3de req-cb76e647-4cb0-4356-9e7f-6f0878abaa4f service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-unplugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2225f0a1-e88e-45b2-8436-e21a12eba3de req-cb76e647-4cb0-4356-9e7f-6f0878abaa4f service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2225f0a1-e88e-45b2-8436-e21a12eba3de req-cb76e647-4cb0-4356-9e7f-6f0878abaa4f service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2225f0a1-e88e-45b2-8436-e21a12eba3de req-cb76e647-4cb0-4356-9e7f-6f0878abaa4f service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-2225f0a1-e88e-45b2-8436-e21a12eba3de req-cb76e647-4cb0-4356-9e7f-6f0878abaa4f service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-unplugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-2225f0a1-e88e-45b2-8436-e21a12eba3de req-cb76e647-4cb0-4356-9e7f-6f0878abaa4f service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-unplugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:19:05 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Instance destroyed successfully.
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lazy-loading 'resources' on Instance uuid a928dcdd-b214-4e5f-84e5-76633d313e4b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T23:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392690336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392690336',id=7,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0IspOOwh4AxJxavAWXMIXxyzIMrl5nEywXM3UCkaIXrQ4id+z3X0cGmiwOi/O0sqc9uZ5aEcv3TENtVTyqVPRYbiCBkzRNPUHJ+VUjOn4PSSiaFmNQVRgZ33uNsYuXlQ==',key_name='tempest-keypair-210828776',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e14a7df237f84c518de0804a57254975',ramdisk_id='',reservation_id='r-kti4w7p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1986589477',owner_user_name='tempest-TaggedAttachmentsTest-1986589477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538446003d4147a586ba8675a3fbef81',uuid=a928dcdd-b214-4e5f-84e5-76633d313e4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converting VIF {"id": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "address": "fa:16:3e:fb:23:fb", "network": {"id": "c9d8f1d6-119e-4253-ba0c-5716f247e9a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-754716098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14a7df237f84c518de0804a57254975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9722bca6-f5", "ovs_interfaceid": "9722bca6-f5a9-46c2-81ab-f50b88433b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:23:fb,bridge_name='br-int',has_traffic_filtering=True,id=9722bca6-f5a9-46c2-81ab-f50b88433b28,network=Network(c9d8f1d6-119e-4253-ba0c-5716f247e9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9722bca6-f5') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG os_vif [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:23:fb,bridge_name='br-int',has_traffic_filtering=True,id=9722bca6-f5a9-46c2-81ab-f50b88433b28,network=Network(c9d8f1d6-119e-4253-ba0c-5716f247e9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9722bca6-f5') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9722bca6-f5, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6dbd5c7-c992-4d64-8f1e-e65f8520418d) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:05 user nova-compute[76391]: INFO os_vif [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:23:fb,bridge_name='br-int',has_traffic_filtering=True,id=9722bca6-f5a9-46c2-81ab-f50b88433b28,network=Network(c9d8f1d6-119e-4253-ba0c-5716f247e9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9722bca6-f5')
Nov 15 23:19:05 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Deleting instance files /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b_del
Nov 15 23:19:05 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Deletion of /opt/stack/data/nova/instances/a928dcdd-b214-4e5f-84e5-76633d313e4b_del complete
Nov 15 23:19:06 user nova-compute[76391]: INFO nova.compute.manager [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:19:06 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 is timed out.
Nov 15 23:19:06 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Successfully detached device vdb from instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 from the live domain config.
Nov 15 23:19:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuJipFOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:19:06 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7de2ab-456a-4203-a36d-3bceec4c14b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:19:06 user nova-compute[76391]: No targets found.
Nov 15 23:19:06 user nova-compute[76391]: iSNS:
Nov 15 23:19:06 user nova-compute[76391]: No targets found.
Nov 15 23:19:06 user nova-compute[76391]: STATIC:
Nov 15 23:19:06 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518
Nov 15 23:19:06 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:19:06 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:19:06 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:19:06 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:19:06 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:19:06 user nova-compute[76391]: FIRMWARE:
Nov 15 23:19:06 user nova-compute[76391]: No targets found.
Nov 15 23:19:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:19:06 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:19:06 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dc56d1-6d73-4ddd-b921-c10ee648d701]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09578f0-850a-430d-ba45-47d298e112d2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:06 user nova-compute[76391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 (non-flash)
Nov 15 23:19:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:06 user nova-compute[76391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 (non-flash)
Nov 15 23:19:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97403527a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2854cd0-7516-4b2a-9156-870d96a8a0cf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa45536-b3e1-448e-ad27-8334ff7fde24]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[751678f0-35d4-4d2b-beeb-16086da42055]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.106s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c368f14-3255-451f-8f45-ba10e6bf884a]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed4a65-685e-41cb-b502-1c9531e44b14]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f099cd6-4359-4eae-9276-f7f778fae840]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260]
Nov 15 23:19:06 user nova-compute[76391]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518, portal: 172.16.0.220,3260] successful.
Nov 15 23:19:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2eb6364-ca6b-4ea5-a3b5-fc99d61dd518 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a1bda-43f0-438a-931e-80f136d484e5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] <== disconnect_volume: return (473ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:07 user nova-compute[76391]: INFO nova.compute.manager [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Terminating instance
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] Acquiring lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] No waiting events found dispatching network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:07 user nova-compute[76391]: WARNING nova.compute.manager [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received unexpected event network-vif-plugged-9722bca6-f5a9-46c2-81ab-f50b88433b28 for instance with vm_state active and task_state deleting.
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-vif-unplugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] No waiting events found dispatching network-vif-unplugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-310c99ee-2573-4cf3-8796-f3f83dd4ca92 req-ceeeaed2-c87f-49a0-a53f-0dc64ba88121 service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-vif-unplugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lazy-loading 'flavor' on Instance uuid 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:07 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Took 1.84 seconds to deallocate network for instance.
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-d4594df7-7f5d-4e88-b36d-10b3c046b5fd req-69bed560-ba7a-4fd3-b7ed-2b8787b024e3 service nova] [instance: a928dcdd-b214-4e5f-84e5-76633d313e4b] Received event network-vif-deleted-9722bca6-f5a9-46c2-81ab-f50b88433b28 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Instance destroyed successfully.
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.objects.instance [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lazy-loading 'resources' on Instance uuid cfe1ee59-af8a-479e-a77d-1c7af3ba30fa {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1367467545',display_name='tempest-TestVolumeSwap-server-1367467545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1367467545',id=4,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuHKKREin+Yf3H03ELdK5t42I5a9bQe4h5jIUsbKtKBvxQUICIJIJJNSjwRCy5GK5SoK862G2D94XBdmjcXLMc5y6e5Y3i1k2EPVUwXIub8C3U6WmZE6SekExH3FlarIA==',key_name='tempest-keypair-1337232033',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:15:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3862491382874ad9921b68be04f08f15',ramdisk_id='',reservation_id='r-9o8goyt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-765121085',owner_user_name='tempest-TestVolumeSwap-765121085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488d63e50e024da5b1ecdf87e2897dce',uuid=cfe1ee59-af8a-479e-a77d-1c7af3ba30fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Converting VIF {"id": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "address": "fa:16:3e:99:29:30", "network": {"id": "3c567556-02de-4aa1-8dae-61cb21537719", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1436979442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3862491382874ad9921b68be04f08f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fadf7b5-53", "ovs_interfaceid": "5fadf7b5-53ec-43d7-9da2-4c09ee12427f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:29:30,bridge_name='br-int',has_traffic_filtering=True,id=5fadf7b5-53ec-43d7-9da2-4c09ee12427f,network=Network(3c567556-02de-4aa1-8dae-61cb21537719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fadf7b5-53') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG os_vif [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:29:30,bridge_name='br-int',has_traffic_filtering=True,id=5fadf7b5-53ec-43d7-9da2-4c09ee12427f,network=Network(3c567556-02de-4aa1-8dae-61cb21537719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fadf7b5-53') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2db0695b-9c57-4767-a32d-c4997dcaa696 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.107s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fadf7b5-53, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee6712d0-7d83-42ed-a1a6-d855798f77ad) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:07 user nova-compute[76391]: INFO os_vif [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:29:30,bridge_name='br-int',has_traffic_filtering=True,id=5fadf7b5-53ec-43d7-9da2-4c09ee12427f,network=Network(3c567556-02de-4aa1-8dae-61cb21537719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fadf7b5-53')
Nov 15 23:19:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Deleting instance files /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa_del
Nov 15 23:19:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Deletion of /opt/stack/data/nova/instances/cfe1ee59-af8a-479e-a77d-1c7af3ba30fa_del complete
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:08 user nova-compute[76391]: INFO nova.compute.manager [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 23:19:08 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:19:08 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:19:08 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:19:08 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:08 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:08 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Deleted allocations for instance a928dcdd-b214-4e5f-84e5-76633d313e4b
Nov 15 23:19:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5db1a44-4975-4133-9bf8-98bc3e64a20c tempest-TaggedAttachmentsTest-1986589477 tempest-TaggedAttachmentsTest-1986589477-project-member] Lock "a928dcdd-b214-4e5f-84e5-76633d313e4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.336s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:09 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Took 1.18 seconds to deallocate network for instance.
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.228s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:19:09 user nova-compute[76391]: INFO nova.compute.claims [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Claim successful on node user
Nov 15 23:19:09 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Deleted allocations for instance cfe1ee59-af8a-479e-a77d-1c7af3ba30fa
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eafce6d3-d7a3-466b-83be-62226072c89d tempest-TestVolumeSwap-765121085 tempest-TestVolumeSwap-765121085-project-member] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.713s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-992196fb-5a8d-4652-afb8-3086502535bc req-1e0041b9-eb05-45b8-9c0c-442a142afb2f service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-992196fb-5a8d-4652-afb8-3086502535bc req-1e0041b9-eb05-45b8-9c0c-442a142afb2f service nova] Acquiring lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-992196fb-5a8d-4652-afb8-3086502535bc req-1e0041b9-eb05-45b8-9c0c-442a142afb2f service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-992196fb-5a8d-4652-afb8-3086502535bc req-1e0041b9-eb05-45b8-9c0c-442a142afb2f service nova] Lock "cfe1ee59-af8a-479e-a77d-1c7af3ba30fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-992196fb-5a8d-4652-afb8-3086502535bc req-1e0041b9-eb05-45b8-9c0c-442a142afb2f service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] No waiting events found dispatching network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:09 user nova-compute[76391]: WARNING nova.compute.manager [req-992196fb-5a8d-4652-afb8-3086502535bc req-1e0041b9-eb05-45b8-9c0c-442a142afb2f service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received unexpected event network-vif-plugged-5fadf7b5-53ec-43d7-9da2-4c09ee12427f for instance with vm_state deleted and task_state None.
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-fa41bf36-568b-4afe-9ea8-3e44e86230db req-e0988f91-1a69-4ce7-b673-e6a8decaed7b service nova] [instance: cfe1ee59-af8a-479e-a77d-1c7af3ba30fa] Received event network-vif-deleted-5fadf7b5-53ec-43d7-9da2-4c09ee12427f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:19:09 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:19:10 user nova-compute[76391]: INFO nova.compute.claims [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Claim successful on node user
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:19:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:19:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:10 user nova-compute[76391]: INFO nova.virt.block_device [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Booting with blank volume at /dev/vda
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.policy [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323a9405e8854778bf826678f8ae876f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c28a381270e4f489acbbc7702c64c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:19:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:19:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Creating image(s)
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG nova.policy [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9170a4bb51b41d289416bb371c98a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472379097b584f5da5aa8f5c919f2e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk 1073741824" returned: 0 in 0.050s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Cannot resize image /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Ensure instance console log exists: /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Successfully created port: 6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:19:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Successfully created port: fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:19:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:19:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:19:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Successfully updated port: 6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:19:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:19:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-changed-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Refreshing instance network info cache due to event network-changed-6553aad5-cc35-490e-95dc-96d4b144728c. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:19:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] Acquiring lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Successfully updated port: fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquired lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance network_info: |[{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] Acquired lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.neutron [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Refreshing network info cache for port 6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updating instance_info_cache with network_info: [{"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Releasing lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance network_info: |[{"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Start _get_guest_xml network_info=[{"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:19:14 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:14 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1570175814',display_name='tempest-tempest.common.compute-instance-1570175814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1570175814',id=16,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi7OcGSXERdzVghj+kaK9/smTbH1RoMpBm3euZr2fWrfoX9QzxsGY0Lot5k/+iXI2d+Dp+Ayun6DHTjVEDJ4lQ1BwidajYYk54Ho+5dt/K7+2DAQQWb4Y0QBXbxxb2JGA==',key_name='tempest-keypair-1702677550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-203e6djh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e08c5f26-850b-4d4a-89ab-88f2066acc71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'pci_devices' on Instance uuid e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:19:14 user nova-compute[76391]:   <uuid>e08c5f26-850b-4d4a-89ab-88f2066acc71</uuid>
Nov 15 23:19:14 user nova-compute[76391]:   <name>instance-00000010</name>
Nov 15 23:19:14 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:19:14 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:19:14 user nova-compute[76391]:   <metadata>
Nov 15 23:19:14 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:19:14 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:19:14 user nova-compute[76391]:       <nova:name>tempest-tempest.common.compute-instance-1570175814</nova:name>
Nov 15 23:19:14 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:19:14</nova:creationTime>
Nov 15 23:19:14 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:19:14 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:19:14 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:19:14 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:19:14 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:19:14 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:19:14 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:19:14 user nova-compute[76391]:       <nova:owner>
Nov 15 23:19:14 user nova-compute[76391]:         <nova:user uuid="c9170a4bb51b41d289416bb371c98a3b">tempest-ServerActionsTestOtherA-1370446029-project-member</nova:user>
Nov 15 23:19:14 user nova-compute[76391]:         <nova:project uuid="472379097b584f5da5aa8f5c919f2e82">tempest-ServerActionsTestOtherA-1370446029</nova:project>
Nov 15 23:19:14 user nova-compute[76391]:       </nova:owner>
Nov 15 23:19:14 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:19:14 user nova-compute[76391]:       <nova:ports>
Nov 15 23:19:14 user nova-compute[76391]:         <nova:port uuid="fb1754d0-2e26-4fb7-865d-01cea7cfed94">
Nov 15 23:19:14 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 23:19:14 user nova-compute[76391]:         </nova:port>
Nov 15 23:19:14 user nova-compute[76391]:       </nova:ports>
Nov 15 23:19:14 user nova-compute[76391]:     </nova:instance>
Nov 15 23:19:14 user nova-compute[76391]:   </metadata>
Nov 15 23:19:14 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:19:14 user nova-compute[76391]:     <system>
Nov 15 23:19:14 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:19:14 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:19:14 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:19:14 user nova-compute[76391]:       <entry name="serial">e08c5f26-850b-4d4a-89ab-88f2066acc71</entry>
Nov 15 23:19:14 user nova-compute[76391]:       <entry name="uuid">e08c5f26-850b-4d4a-89ab-88f2066acc71</entry>
Nov 15 23:19:14 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:19:14 user nova-compute[76391]:     </system>
Nov 15 23:19:14 user nova-compute[76391]:   </sysinfo>
Nov 15 23:19:14 user nova-compute[76391]:   <os>
Nov 15 23:19:14 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:19:14 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:19:14 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:19:14 user nova-compute[76391]:   </os>
Nov 15 23:19:14 user nova-compute[76391]:   <features>
Nov 15 23:19:14 user nova-compute[76391]:     <acpi/>
Nov 15 23:19:14 user nova-compute[76391]:     <apic/>
Nov 15 23:19:14 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:19:14 user nova-compute[76391]:   </features>
Nov 15 23:19:14 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:19:14 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:19:14 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:19:14 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:19:14 user nova-compute[76391]:   </clock>
Nov 15 23:19:14 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:19:14 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:19:14 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:19:14 user nova-compute[76391]:   </cpu>
Nov 15 23:19:14 user nova-compute[76391]:   <devices>
Nov 15 23:19:14 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:19:14 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:19:14 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk"/>
Nov 15 23:19:14 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:19:14 user nova-compute[76391]:     </disk>
Nov 15 23:19:14 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:19:14 user nova-compute[76391]:       <mac address="fa:16:3e:aa:01:54"/>
Nov 15 23:19:14 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:14 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:19:14 user nova-compute[76391]:       <target dev="tapfb1754d0-2e"/>
Nov 15 23:19:14 user nova-compute[76391]:     </interface>
Nov 15 23:19:14 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:19:14 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/console.log" append="off"/>
Nov 15 23:19:14 user nova-compute[76391]:     </serial>
Nov 15 23:19:14 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:19:14 user nova-compute[76391]:     <video>
Nov 15 23:19:14 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:14 user nova-compute[76391]:     </video>
Nov 15 23:19:14 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:19:14 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:19:14 user nova-compute[76391]:     </rng>
Nov 15 23:19:14 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:19:14 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:19:14 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:19:14 user nova-compute[76391]:     </memballoon>
Nov 15 23:19:14 user nova-compute[76391]:   </devices>
Nov 15 23:19:14 user nova-compute[76391]: </domain>
Nov 15 23:19:14 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1570175814',display_name='tempest-tempest.common.compute-instance-1570175814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1570175814',id=16,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi7OcGSXERdzVghj+kaK9/smTbH1RoMpBm3euZr2fWrfoX9QzxsGY0Lot5k/+iXI2d+Dp+Ayun6DHTjVEDJ4lQ1BwidajYYk54Ho+5dt/K7+2DAQQWb4Y0QBXbxxb2JGA==',key_name='tempest-keypair-1702677550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-203e6djh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e08c5f26-850b-4d4a-89ab-88f2066acc71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG os_vif [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db0f43d0-f338-5a95-bd95-01706ffccb73', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb1754d0-2e, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb1754d0-2e, col_values=(('qos', UUID('5942f899-0a9f-4676-bdf3-b0a5cfbf831e')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb1754d0-2e, col_values=(('external_ids', {'iface-id': 'fb1754d0-2e26-4fb7-865d-01cea7cfed94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:01:54', 'vm-uuid': 'e08c5f26-850b-4d4a-89ab-88f2066acc71'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:14 user nova-compute[76391]: INFO os_vif [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e')
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No VIF found with MAC fa:16:3e:aa:01:54, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:19:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG nova.network.neutron [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updated VIF entry in instance network info cache for port 6553aad5-cc35-490e-95dc-96d4b144728c. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG nova.network.neutron [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-733f1113-57d3-403d-a533-4415bf7ea828 req-03a8d35e-edff-48b2-bf68-34beb5dbfb28 service nova] Releasing lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG os_brick.utils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-changed-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Refreshing instance network info cache due to event network-changed-fb1754d0-2e26-4fb7-865d-01cea7cfed94. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] Acquiring lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] Acquired lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG nova.network.neutron [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Refreshing network info cache for port fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a56ea-e71a-4724-a435-111f70644c01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f1cd0-76d3-4101-89bb-7c25bee23cb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c93d6-88a4-4787-ae04-91798d18f564]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ff083-c69d-4a9a-aa23-1a84f9401c3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:19:15 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:19:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d43b0-ec5b-430a-afef-7c0aa94000e9]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG os_brick.utils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:19:15 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating existing volume attachment record: c64dae39-2834-4854-9d24-f85241d10423 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-2a481429-7f8f-4bf8-802a-1df044d930a3 req-191b7c6b-0c5f-406a-bc66-0b1fe1c7ee93 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2a481429-7f8f-4bf8-802a-1df044d930a3 req-191b7c6b-0c5f-406a-bc66-0b1fe1c7ee93 service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2a481429-7f8f-4bf8-802a-1df044d930a3 req-191b7c6b-0c5f-406a-bc66-0b1fe1c7ee93 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2a481429-7f8f-4bf8-802a-1df044d930a3 req-191b7c6b-0c5f-406a-bc66-0b1fe1c7ee93 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-2a481429-7f8f-4bf8-802a-1df044d930a3 req-191b7c6b-0c5f-406a-bc66-0b1fe1c7ee93 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:16 user nova-compute[76391]: WARNING nova.compute.manager [req-2a481429-7f8f-4bf8-802a-1df044d930a3 req-191b7c6b-0c5f-406a-bc66-0b1fe1c7ee93 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state building and task_state spawning.
Nov 15 23:19:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updated VIF entry in instance network info cache for port fb1754d0-2e26-4fb7-865d-01cea7cfed94. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updating instance_info_cache with network_info: [{"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b0870c57-9cac-489d-9621-01761fd85e25 req-d8a62715-ba32-44c1-9f3f-9371b031ce45 service nova] Releasing lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:19:18 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance spawned successfully.
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:18 user nova-compute[76391]: INFO nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-58d070af-8bea-401b-96ef-ef6f2b18d7ad req-08c9b5fa-2ccc-490b-93e3-534aa07d20d3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-58d070af-8bea-401b-96ef-ef6f2b18d7ad req-08c9b5fa-2ccc-490b-93e3-534aa07d20d3 service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-58d070af-8bea-401b-96ef-ef6f2b18d7ad req-08c9b5fa-2ccc-490b-93e3-534aa07d20d3 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-58d070af-8bea-401b-96ef-ef6f2b18d7ad req-08c9b5fa-2ccc-490b-93e3-534aa07d20d3 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-58d070af-8bea-401b-96ef-ef6f2b18d7ad req-08c9b5fa-2ccc-490b-93e3-534aa07d20d3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:18 user nova-compute[76391]: WARNING nova.compute.manager [req-58d070af-8bea-401b-96ef-ef6f2b18d7ad req-08c9b5fa-2ccc-490b-93e3-534aa07d20d3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state building and task_state spawning.
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:18 user nova-compute[76391]: INFO nova.compute.manager [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Took 8.67 seconds to build instance.
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-014a5206-face-4eab-aace-4663877750e6 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.804s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:20 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:20 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=25.489498138427734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance eb286b41-55ed-4a38-8e66-6edb5f0ccd0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e08c5f26-850b-4d4a-89ab-88f2066acc71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:19:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:19:21 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Creating image(s)
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Ensure instance console log exists: /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Start _get_guest_xml network_info=[{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndmToLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4559c90b-6fb9-4190-8d40-0832c743c2c7', 'attached_at': '', 'detached_at': '', 'volume_id': '283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'serial': '283d147a-4ff2-4fea-a7fb-ee4113eaa7cd'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'c64dae39-2834-4854-9d24-f85241d10423', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:19:21 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:21 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndmToLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:19:21 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:19:21 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:19:21 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[556314b0-2067-467b-9bbb-18b5ff5e52ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:19:21 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ee40e-ce16-4606-b870-3aecad7e8938]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd] added
Nov 15 23:19:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe7342-9e41-45b4-b050-404dd93620c6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f34438-0ee8-4565-9519-7dd11363680d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YndmToLu {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YndmToLu" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c7a739-ab34-4eda-a640-602e99642cc6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YndmToLu'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8933bfe8-bad2-40f7-b54b-23c130592102]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:19:21 user nova-compute[76391]: INFO nova.compute.claims [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Claim successful on node user
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af60b6b-1b57-4b04-8bc8-be81f72fdce6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa5dde3-5bbb-438a-8c56-09ee44e4893f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260]
Nov 15 23:19:21 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260] successful.
Nov 15 23:19:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335f17c-69a8-4b91-ae1f-3fbbba3970aa]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2362dfea-1a15-4fc5-9dd1-e3c9a61affd5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:21 user nova-compute[76391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:19:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:21 user nova-compute[76391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:19:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49695f9-5e46-430c-a17c-bdeff270a0d5]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndmToLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:19:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.796s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:19:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.policy [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3986dd9981e24a0f8faf441662255bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d522b2994d4474999b1a2d2d474c74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23033633431616633', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633431616633', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:19:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Creating image(s)
Nov 15 23:19:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173822820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173822820',id=15,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-xcuqv6hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:10Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=4559c90b-6fb9-4190-8d40-0832c743c2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'pci_devices' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:19:23 user nova-compute[76391]:   <uuid>4559c90b-6fb9-4190-8d40-0832c743c2c7</uuid>
Nov 15 23:19:23 user nova-compute[76391]:   <name>instance-0000000f</name>
Nov 15 23:19:23 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:19:23 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:19:23 user nova-compute[76391]:   <metadata>
Nov 15 23:19:23 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:19:23 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:19:23 user nova-compute[76391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-173822820</nova:name>
Nov 15 23:19:23 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:19:21</nova:creationTime>
Nov 15 23:19:23 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:19:23 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:19:23 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:19:23 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:19:23 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:19:23 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:19:23 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:19:23 user nova-compute[76391]:       <nova:owner>
Nov 15 23:19:23 user nova-compute[76391]:         <nova:user uuid="323a9405e8854778bf826678f8ae876f">tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member</nova:user>
Nov 15 23:19:23 user nova-compute[76391]:         <nova:project uuid="9c28a381270e4f489acbbc7702c64c61">tempest-ServerBootFromVolumeStableRescueTest-194934661</nova:project>
Nov 15 23:19:23 user nova-compute[76391]:       </nova:owner>
Nov 15 23:19:23 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:19:23 user nova-compute[76391]:       <nova:ports>
Nov 15 23:19:23 user nova-compute[76391]:         <nova:port uuid="6553aad5-cc35-490e-95dc-96d4b144728c">
Nov 15 23:19:23 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 23:19:23 user nova-compute[76391]:         </nova:port>
Nov 15 23:19:23 user nova-compute[76391]:       </nova:ports>
Nov 15 23:19:23 user nova-compute[76391]:     </nova:instance>
Nov 15 23:19:23 user nova-compute[76391]:   </metadata>
Nov 15 23:19:23 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:19:23 user nova-compute[76391]:     <system>
Nov 15 23:19:23 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:19:23 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:19:23 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:19:23 user nova-compute[76391]:       <entry name="serial">4559c90b-6fb9-4190-8d40-0832c743c2c7</entry>
Nov 15 23:19:23 user nova-compute[76391]:       <entry name="uuid">4559c90b-6fb9-4190-8d40-0832c743c2c7</entry>
Nov 15 23:19:23 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:19:23 user nova-compute[76391]:     </system>
Nov 15 23:19:23 user nova-compute[76391]:   </sysinfo>
Nov 15 23:19:23 user nova-compute[76391]:   <os>
Nov 15 23:19:23 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:19:23 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:19:23 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:19:23 user nova-compute[76391]:   </os>
Nov 15 23:19:23 user nova-compute[76391]:   <features>
Nov 15 23:19:23 user nova-compute[76391]:     <acpi/>
Nov 15 23:19:23 user nova-compute[76391]:     <apic/>
Nov 15 23:19:23 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:19:23 user nova-compute[76391]:   </features>
Nov 15 23:19:23 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:19:23 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:19:23 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:19:23 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:19:23 user nova-compute[76391]:   </clock>
Nov 15 23:19:23 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:19:23 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:19:23 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:19:23 user nova-compute[76391]:   </cpu>
Nov 15 23:19:23 user nova-compute[76391]:   <devices>
Nov 15 23:19:23 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:19:23 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:19:23 user nova-compute[76391]:       <source dev="/dev/sdb"/>
Nov 15 23:19:23 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:19:23 user nova-compute[76391]:       <serial>283d147a-4ff2-4fea-a7fb-ee4113eaa7cd</serial>
Nov 15 23:19:23 user nova-compute[76391]:     </disk>
Nov 15 23:19:23 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:19:23 user nova-compute[76391]:       <mac address="fa:16:3e:2f:58:72"/>
Nov 15 23:19:23 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:23 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:19:23 user nova-compute[76391]:       <target dev="tap6553aad5-cc"/>
Nov 15 23:19:23 user nova-compute[76391]:     </interface>
Nov 15 23:19:23 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:19:23 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/console.log" append="off"/>
Nov 15 23:19:23 user nova-compute[76391]:     </serial>
Nov 15 23:19:23 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:19:23 user nova-compute[76391]:     <video>
Nov 15 23:19:23 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:23 user nova-compute[76391]:     </video>
Nov 15 23:19:23 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:19:23 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:19:23 user nova-compute[76391]:     </rng>
Nov 15 23:19:23 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:19:23 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:19:23 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:19:23 user nova-compute[76391]:     </memballoon>
Nov 15 23:19:23 user nova-compute[76391]:   </devices>
Nov 15 23:19:23 user nova-compute[76391]: </domain>
Nov 15 23:19:23 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173822820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173822820',id=15,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-xcuqv6hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:10Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=4559c90b-6fb9-4190-8d40-0832c743c2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG os_vif [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7765718-b254-50e8-a9d1-c74307e3df18', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6553aad5-cc, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6553aad5-cc, col_values=(('qos', UUID('e0f8f0a7-df74-4764-b8c0-7d77e0960f02')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6553aad5-cc, col_values=(('external_ids', {'iface-id': '6553aad5-cc35-490e-95dc-96d4b144728c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:58:72', 'vm-uuid': '4559c90b-6fb9-4190-8d40-0832c743c2c7'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:23 user nova-compute[76391]: INFO os_vif [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc')
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:19:23 user nova-compute[76391]: INFO nova.compute.claims [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Claim successful on node user
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No VIF found with MAC fa:16:3e:2f:58:72, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.204s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.220s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk 1073741824" returned: 0 in 0.060s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.226s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Cannot resize image /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Ensure instance console log exists: /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:19:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:19:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Creating image(s)
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.policy [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3986dd9981e24a0f8faf441662255bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d522b2994d4474999b1a2d2d474c74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Successfully created port: 914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.205s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.248s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk 1073741824" returned: 0 in 0.056s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:19:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-661afa03-13a1-47fe-a93b-e76ca093eb33 req-a9d6c1cc-14c3-4117-bc12-af8ed7aacdbf service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-661afa03-13a1-47fe-a93b-e76ca093eb33 req-a9d6c1cc-14c3-4117-bc12-af8ed7aacdbf service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-661afa03-13a1-47fe-a93b-e76ca093eb33 req-a9d6c1cc-14c3-4117-bc12-af8ed7aacdbf service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-661afa03-13a1-47fe-a93b-e76ca093eb33 req-a9d6c1cc-14c3-4117-bc12-af8ed7aacdbf service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-661afa03-13a1-47fe-a93b-e76ca093eb33 req-a9d6c1cc-14c3-4117-bc12-af8ed7aacdbf service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:25 user nova-compute[76391]: WARNING nova.compute.manager [req-661afa03-13a1-47fe-a93b-e76ca093eb33 req-a9d6c1cc-14c3-4117-bc12-af8ed7aacdbf service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state building and task_state spawning.
Nov 15 23:19:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Cannot resize image /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Ensure instance console log exists: /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Successfully created port: 20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Successfully updated port: 914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-changed-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Refreshing instance network info cache due to event network-changed-914d7841-8a90-461e-83d6-efd74735dc0e. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] Acquiring lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:19:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance spawned successfully.
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updating instance_info_cache with network_info: [{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance network_info: |[{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] Acquired lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.neutron [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Refreshing network info cache for port 914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Start _get_guest_xml network_info=[{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:19:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1775411528',display_name='tempest-ServerRescueNegativeTestJSON-server-1775411528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1775411528',id=17,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-xj9j2eo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:23Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=bfb44f27-ed01-4f78-a982-5302163e5069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'pci_devices' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:26 user nova-compute[76391]: INFO nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:19:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:19:26 user nova-compute[76391]:   <uuid>bfb44f27-ed01-4f78-a982-5302163e5069</uuid>
Nov 15 23:19:26 user nova-compute[76391]:   <name>instance-00000011</name>
Nov 15 23:19:26 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:19:26 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:19:26 user nova-compute[76391]:   <metadata>
Nov 15 23:19:26 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:19:26 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:19:26 user nova-compute[76391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1775411528</nova:name>
Nov 15 23:19:26 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:19:26</nova:creationTime>
Nov 15 23:19:26 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:19:26 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:19:26 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:19:26 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:19:26 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:19:26 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:19:26 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:19:26 user nova-compute[76391]:       <nova:owner>
Nov 15 23:19:26 user nova-compute[76391]:         <nova:user uuid="3986dd9981e24a0f8faf441662255bab">tempest-ServerRescueNegativeTestJSON-1623431733-project-member</nova:user>
Nov 15 23:19:26 user nova-compute[76391]:         <nova:project uuid="3d522b2994d4474999b1a2d2d474c74b">tempest-ServerRescueNegativeTestJSON-1623431733</nova:project>
Nov 15 23:19:26 user nova-compute[76391]:       </nova:owner>
Nov 15 23:19:26 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:19:26 user nova-compute[76391]:       <nova:ports>
Nov 15 23:19:26 user nova-compute[76391]:         <nova:port uuid="914d7841-8a90-461e-83d6-efd74735dc0e">
Nov 15 23:19:26 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 23:19:26 user nova-compute[76391]:         </nova:port>
Nov 15 23:19:26 user nova-compute[76391]:       </nova:ports>
Nov 15 23:19:26 user nova-compute[76391]:     </nova:instance>
Nov 15 23:19:26 user nova-compute[76391]:   </metadata>
Nov 15 23:19:26 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:19:26 user nova-compute[76391]:     <system>
Nov 15 23:19:26 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:19:26 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:19:26 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:19:26 user nova-compute[76391]:       <entry name="serial">bfb44f27-ed01-4f78-a982-5302163e5069</entry>
Nov 15 23:19:26 user nova-compute[76391]:       <entry name="uuid">bfb44f27-ed01-4f78-a982-5302163e5069</entry>
Nov 15 23:19:26 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:19:26 user nova-compute[76391]:     </system>
Nov 15 23:19:26 user nova-compute[76391]:   </sysinfo>
Nov 15 23:19:26 user nova-compute[76391]:   <os>
Nov 15 23:19:26 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:19:26 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:19:26 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:19:26 user nova-compute[76391]:   </os>
Nov 15 23:19:26 user nova-compute[76391]:   <features>
Nov 15 23:19:26 user nova-compute[76391]:     <acpi/>
Nov 15 23:19:26 user nova-compute[76391]:     <apic/>
Nov 15 23:19:26 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:19:26 user nova-compute[76391]:   </features>
Nov 15 23:19:26 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:19:26 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:19:26 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:19:26 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:19:26 user nova-compute[76391]:   </clock>
Nov 15 23:19:26 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:19:26 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:19:26 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:19:26 user nova-compute[76391]:   </cpu>
Nov 15 23:19:26 user nova-compute[76391]:   <devices>
Nov 15 23:19:26 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:19:26 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:19:26 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk"/>
Nov 15 23:19:26 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:19:26 user nova-compute[76391]:     </disk>
Nov 15 23:19:26 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:19:26 user nova-compute[76391]:       <mac address="fa:16:3e:2b:dd:a0"/>
Nov 15 23:19:26 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:26 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:19:26 user nova-compute[76391]:       <target dev="tap914d7841-8a"/>
Nov 15 23:19:26 user nova-compute[76391]:     </interface>
Nov 15 23:19:26 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:19:26 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/console.log" append="off"/>
Nov 15 23:19:26 user nova-compute[76391]:     </serial>
Nov 15 23:19:26 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:19:26 user nova-compute[76391]:     <video>
Nov 15 23:19:26 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:26 user nova-compute[76391]:     </video>
Nov 15 23:19:26 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:19:26 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:19:26 user nova-compute[76391]:     </rng>
Nov 15 23:19:26 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:19:26 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:19:26 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:19:26 user nova-compute[76391]:     </memballoon>
Nov 15 23:19:26 user nova-compute[76391]:   </devices>
Nov 15 23:19:26 user nova-compute[76391]: </domain>
Nov 15 23:19:26 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1775411528',display_name='tempest-ServerRescueNegativeTestJSON-server-1775411528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1775411528',id=17,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-xj9j2eo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:23Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=bfb44f27-ed01-4f78-a982-5302163e5069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG os_vif [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '478dd647-394f-5968-8abd-a3466a709911', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap914d7841-8a, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap914d7841-8a, col_values=(('qos', UUID('36af603f-e36d-4189-bd4e-fae8e4c1997a')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap914d7841-8a, col_values=(('external_ids', {'iface-id': '914d7841-8a90-461e-83d6-efd74735dc0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:dd:a0', 'vm-uuid': 'bfb44f27-ed01-4f78-a982-5302163e5069'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:27 user nova-compute[76391]: INFO os_vif [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a')
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-6cd3a3f0-4e20-4849-bbc1-5f29d345721e req-59350709-ba62-449a-830c-0fa09fa3f72b service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6cd3a3f0-4e20-4849-bbc1-5f29d345721e req-59350709-ba62-449a-830c-0fa09fa3f72b service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6cd3a3f0-4e20-4849-bbc1-5f29d345721e req-59350709-ba62-449a-830c-0fa09fa3f72b service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6cd3a3f0-4e20-4849-bbc1-5f29d345721e req-59350709-ba62-449a-830c-0fa09fa3f72b service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-6cd3a3f0-4e20-4849-bbc1-5f29d345721e req-59350709-ba62-449a-830c-0fa09fa3f72b service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:27 user nova-compute[76391]: WARNING nova.compute.manager [req-6cd3a3f0-4e20-4849-bbc1-5f29d345721e req-59350709-ba62-449a-830c-0fa09fa3f72b service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state building and task_state spawning.
Nov 15 23:19:27 user nova-compute[76391]: INFO nova.compute.manager [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Took 17.77 seconds to build instance.
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9ff2d13e-7387-46a3-9255-783250f55f0b tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.898s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No VIF found with MAC fa:16:3e:2b:dd:a0, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Successfully updated port: 20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updated VIF entry in instance network info cache for port 914d7841-8a90-461e-83d6-efd74735dc0e. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updating instance_info_cache with network_info: [{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4dbf4fe7-e076-48cb-99dd-3672805ab11e req-150088af-3300-494a-8a2a-961e8ba42c2d service nova] Releasing lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:19:27 user nova-compute[76391]: INFO nova.compute.claims [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Claim successful on node user
Nov 15 23:19:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updating instance_info_cache with network_info: [{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance network_info: |[{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Start _get_guest_xml network_info=[{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:19:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-893601650',display_name='tempest-ServerRescueNegativeTestJSON-server-893601650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-893601650',id=18,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-owkocc4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:24Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=d1c8427a-7299-4332-82eb-afc545cb6f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'pci_devices' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:19:28 user nova-compute[76391]:   <uuid>d1c8427a-7299-4332-82eb-afc545cb6f8d</uuid>
Nov 15 23:19:28 user nova-compute[76391]:   <name>instance-00000012</name>
Nov 15 23:19:28 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:19:28 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:19:28 user nova-compute[76391]:   <metadata>
Nov 15 23:19:28 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:19:28 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:19:28 user nova-compute[76391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-893601650</nova:name>
Nov 15 23:19:28 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:19:28</nova:creationTime>
Nov 15 23:19:28 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:19:28 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:19:28 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:19:28 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:19:28 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:19:28 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:19:28 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:19:28 user nova-compute[76391]:       <nova:owner>
Nov 15 23:19:28 user nova-compute[76391]:         <nova:user uuid="3986dd9981e24a0f8faf441662255bab">tempest-ServerRescueNegativeTestJSON-1623431733-project-member</nova:user>
Nov 15 23:19:28 user nova-compute[76391]:         <nova:project uuid="3d522b2994d4474999b1a2d2d474c74b">tempest-ServerRescueNegativeTestJSON-1623431733</nova:project>
Nov 15 23:19:28 user nova-compute[76391]:       </nova:owner>
Nov 15 23:19:28 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:19:28 user nova-compute[76391]:       <nova:ports>
Nov 15 23:19:28 user nova-compute[76391]:         <nova:port uuid="20833cf0-a0ae-4ea9-ad8d-d9f002e6f092">
Nov 15 23:19:28 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:19:28 user nova-compute[76391]:         </nova:port>
Nov 15 23:19:28 user nova-compute[76391]:       </nova:ports>
Nov 15 23:19:28 user nova-compute[76391]:     </nova:instance>
Nov 15 23:19:28 user nova-compute[76391]:   </metadata>
Nov 15 23:19:28 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:19:28 user nova-compute[76391]:     <system>
Nov 15 23:19:28 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:19:28 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:19:28 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:19:28 user nova-compute[76391]:       <entry name="serial">d1c8427a-7299-4332-82eb-afc545cb6f8d</entry>
Nov 15 23:19:28 user nova-compute[76391]:       <entry name="uuid">d1c8427a-7299-4332-82eb-afc545cb6f8d</entry>
Nov 15 23:19:28 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:19:28 user nova-compute[76391]:     </system>
Nov 15 23:19:28 user nova-compute[76391]:   </sysinfo>
Nov 15 23:19:28 user nova-compute[76391]:   <os>
Nov 15 23:19:28 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:19:28 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:19:28 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:19:28 user nova-compute[76391]:   </os>
Nov 15 23:19:28 user nova-compute[76391]:   <features>
Nov 15 23:19:28 user nova-compute[76391]:     <acpi/>
Nov 15 23:19:28 user nova-compute[76391]:     <apic/>
Nov 15 23:19:28 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:19:28 user nova-compute[76391]:   </features>
Nov 15 23:19:28 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:19:28 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:19:28 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:19:28 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:19:28 user nova-compute[76391]:   </clock>
Nov 15 23:19:28 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:19:28 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:19:28 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:19:28 user nova-compute[76391]:   </cpu>
Nov 15 23:19:28 user nova-compute[76391]:   <devices>
Nov 15 23:19:28 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:19:28 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:19:28 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk"/>
Nov 15 23:19:28 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:19:28 user nova-compute[76391]:     </disk>
Nov 15 23:19:28 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:19:28 user nova-compute[76391]:       <mac address="fa:16:3e:82:66:f3"/>
Nov 15 23:19:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:28 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:19:28 user nova-compute[76391]:       <target dev="tap20833cf0-a0"/>
Nov 15 23:19:28 user nova-compute[76391]:     </interface>
Nov 15 23:19:28 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:19:28 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/console.log" append="off"/>
Nov 15 23:19:28 user nova-compute[76391]:     </serial>
Nov 15 23:19:28 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:19:28 user nova-compute[76391]:     <video>
Nov 15 23:19:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:28 user nova-compute[76391]:     </video>
Nov 15 23:19:28 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:19:28 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:19:28 user nova-compute[76391]:     </rng>
Nov 15 23:19:28 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:19:28 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:19:28 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:19:28 user nova-compute[76391]:     </memballoon>
Nov 15 23:19:28 user nova-compute[76391]:   </devices>
Nov 15 23:19:28 user nova-compute[76391]: </domain>
Nov 15 23:19:28 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-893601650',display_name='tempest-ServerRescueNegativeTestJSON-server-893601650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-893601650',id=18,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-owkocc4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:24Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=d1c8427a-7299-4332-82eb-afc545cb6f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG os_vif [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db91bc92-007b-5ac3-bb29-87e05e3ecea7', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20833cf0-a0, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20833cf0-a0, col_values=(('qos', UUID('5f496dcb-7372-40ad-928b-07699d52a5eb')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20833cf0-a0, col_values=(('external_ids', {'iface-id': '20833cf0-a0ae-4ea9-ad8d-d9f002e6f092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:66:f3', 'vm-uuid': 'd1c8427a-7299-4332-82eb-afc545cb6f8d'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: INFO os_vif [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0')
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No VIF found with MAC fa:16:3e:82:66:f3, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:19:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.policy [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d5fb40133174f4db6f71696591de2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc691a9d5674fbb898dd6736e91613f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-changed-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Refreshing instance network info cache due to event network-changed-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] Acquiring lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] Acquired lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Refreshing network info cache for port 20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:19:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Creating image(s)
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "/opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "/opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "/opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-c508a925-bfe5-4043-89c2-6d07e7ff85ff req-9be63906-fca3-41b7-9737-a44973582cf5 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c508a925-bfe5-4043-89c2-6d07e7ff85ff req-9be63906-fca3-41b7-9737-a44973582cf5 service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c508a925-bfe5-4043-89c2-6d07e7ff85ff req-9be63906-fca3-41b7-9737-a44973582cf5 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c508a925-bfe5-4043-89c2-6d07e7ff85ff req-9be63906-fca3-41b7-9737-a44973582cf5 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-c508a925-bfe5-4043-89c2-6d07e7ff85ff req-9be63906-fca3-41b7-9737-a44973582cf5 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:28 user nova-compute[76391]: WARNING nova.compute.manager [req-c508a925-bfe5-4043-89c2-6d07e7ff85ff req-9be63906-fca3-41b7-9737-a44973582cf5 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state building and task_state spawning.
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.237s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:29 user nova-compute[76391]: INFO nova.compute.manager [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Terminating instance
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.235s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk 1073741824" returned: 0 in 0.086s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updated VIF entry in instance network info cache for port 20833cf0-a0ae-4ea9-ad8d-d9f002e6f092. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updating instance_info_cache with network_info: [{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-45efa7dc-ae8a-4cdd-ad20-6cc8bb5b4c66 req-5255f334-2ac3-4fcd-9f11-906c85ac89ae service nova] Releasing lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.network.neutron [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Successfully created port: 7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-c36a17ae-51c9-4ddb-b993-ee05acd5cd75 req-ff79efe9-8fdd-46b1-9244-4d2ee651a021 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-unplugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c36a17ae-51c9-4ddb-b993-ee05acd5cd75 req-ff79efe9-8fdd-46b1-9244-4d2ee651a021 service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c36a17ae-51c9-4ddb-b993-ee05acd5cd75 req-ff79efe9-8fdd-46b1-9244-4d2ee651a021 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c36a17ae-51c9-4ddb-b993-ee05acd5cd75 req-ff79efe9-8fdd-46b1-9244-4d2ee651a021 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-c36a17ae-51c9-4ddb-b993-ee05acd5cd75 req-ff79efe9-8fdd-46b1-9244-4d2ee651a021 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-unplugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-c36a17ae-51c9-4ddb-b993-ee05acd5cd75 req-ff79efe9-8fdd-46b1-9244-4d2ee651a021 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-unplugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Cannot resize image /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Ensure instance console log exists: /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.neutron [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Successfully updated port: 7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquired lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.neutron [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:19:30 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Instance destroyed successfully.
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.objects.instance [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lazy-loading 'resources' on Instance uuid eb286b41-55ed-4a38-8e66-6edb5f0ccd0e {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1817328166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1185346505',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgS5owXYTIhp2CyONYKVA6cDqle9QogIygYExxZVew6Eyp+xF5P9KjoNDuUWixbTD8FG5eY4YFl/RQGWgxPOIDDfU+kWnosaJaWDfsFFB/PSD6XOidlEmphF4w4bqLdug==',key_name='tempest-keypair-2000121693',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:18:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99cf3b6665eb46cf93ec4b66f688dfe4',ramdisk_id='',reservation_id='r-s984ualt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1456826566',owner_user_name='tempest-ServerActionsV293TestJSON-1456826566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec4681c47a4458888403c64e96f59d2',uuid=eb286b41-55ed-4a38-8e66-6edb5f0ccd0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converting VIF {"id": "b09aad63-4edf-494c-808a-4b0472dfdd18", "address": "fa:16:3e:96:ea:ad", "network": {"id": "894e38c4-4404-4f4b-96a6-07d7dea6d7b1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2050065811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf3b6665eb46cf93ec4b66f688dfe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09aad63-4e", "ovs_interfaceid": "b09aad63-4edf-494c-808a-4b0472dfdd18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_vif [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.neutron [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb09aad63-4e, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=029d3987-db28-4e07-8450-fcb1e10ab17a) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: INFO os_vif [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=b09aad63-4edf-494c-808a-4b0472dfdd18,network=Network(894e38c4-4404-4f4b-96a6-07d7dea6d7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09aad63-4e')
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtkNBJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:19:30 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c51b97-fcdd-482d-8666-a5d8a53f95d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:19:30 user nova-compute[76391]: No targets found.
Nov 15 23:19:30 user nova-compute[76391]: iSNS:
Nov 15 23:19:30 user nova-compute[76391]: No targets found.
Nov 15 23:19:30 user nova-compute[76391]: STATIC:
Nov 15 23:19:30 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67
Nov 15 23:19:30 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:19:30 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:19:30 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:19:30 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:19:30 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:19:30 user nova-compute[76391]: FIRMWARE:
Nov 15 23:19:30 user nova-compute[76391]: No targets found.
Nov 15 23:19:30 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:19:30 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:19:30 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7509c7-3901-4008-93eb-20310f49dc3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cc0ee2-3025-4f9b-91c9-ddb69c5284bb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:30 user nova-compute[76391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:19:30 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 (non-flash)
Nov 15 23:19:30 user nova-compute[76391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:19:30 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740341750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05906741-168b-4e59-9c35-8d4573560be8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b2e9f5-4d32-4ef7-9030-39517eacd3d9]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d42381c-3e37-4e0a-9dd0-1cee2d6bf5e3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ab63ec-ca73-485a-99b3-62d7fc67ce97]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received event network-changed-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Refreshing instance network info cache due to event network-changed-7c20a743-d1b7-49b9-b84d-f9b1e7262230. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] Acquiring lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb41796-d03a-462e-b1f0-43ac3aec1628]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f1e0a-9c0f-489c-b1e5-4af590a14f5d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260]
Nov 15 23:19:30 user nova-compute[76391]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67, portal: 172.16.0.220,3260] successful.
Nov 15 23:19:30 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.neutron [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Updating instance_info_cache with network_info: [{"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba4cc50-1dea-41a7-93f3-7c414425be67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c1f1ca-9828-4d54-923e-376da5aefad5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] <== disconnect_volume: return (424ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:19:30 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Deleting instance files /opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e_del
Nov 15 23:19:30 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Deletion of /opt/stack/data/nova/instances/eb286b41-55ed-4a38-8e66-6edb5f0ccd0e_del complete
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Releasing lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Instance network_info: |[{"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] Acquired lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Refreshing network info cache for port 7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Start _get_guest_xml network_info=[{"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:19:30 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:30 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-3994a13a-656b-478a-b954-fe97d4bf078d req-6e09524f-e75d-4f93-bd40-f5d7d6fcddad service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3994a13a-656b-478a-b954-fe97d4bf078d req-6e09524f-e75d-4f93-bd40-f5d7d6fcddad service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3994a13a-656b-478a-b954-fe97d4bf078d req-6e09524f-e75d-4f93-bd40-f5d7d6fcddad service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3994a13a-656b-478a-b954-fe97d4bf078d req-6e09524f-e75d-4f93-bd40-f5d7d6fcddad service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-3994a13a-656b-478a-b954-fe97d4bf078d req-6e09524f-e75d-4f93-bd40-f5d7d6fcddad service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:30 user nova-compute[76391]: WARNING nova.compute.manager [req-3994a13a-656b-478a-b954-fe97d4bf078d req-6e09524f-e75d-4f93-bd40-f5d7d6fcddad service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state building and task_state spawning.
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1742095287',display_name='tempest-ServersNegativeTestJSON-server-1742095287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1742095287',id=19,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bc691a9d5674fbb898dd6736e91613f',ramdisk_id='',reservation_id='r-5xxovw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-686980340',owner_user_name='tempest-ServersNegativeTestJSON-686980340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:28Z,user_data=None,user_id='9d5fb40133174f4db6f71696591de2a8',uuid=39cdf492-9c79-47f4-9437-aab5284b4dd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converting VIF {"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c20a743-d1b7-49b9-b84d-f9b1e7262230,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c20a743-d1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.objects.instance [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lazy-loading 'pci_devices' on Instance uuid 39cdf492-9c79-47f4-9437-aab5284b4dd3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:19:30 user nova-compute[76391]:   <uuid>39cdf492-9c79-47f4-9437-aab5284b4dd3</uuid>
Nov 15 23:19:30 user nova-compute[76391]:   <name>instance-00000013</name>
Nov 15 23:19:30 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:19:30 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:19:30 user nova-compute[76391]:   <metadata>
Nov 15 23:19:30 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:19:30 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:19:30 user nova-compute[76391]:       <nova:name>tempest-ServersNegativeTestJSON-server-1742095287</nova:name>
Nov 15 23:19:30 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:19:30</nova:creationTime>
Nov 15 23:19:30 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:19:30 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:19:30 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:19:30 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:19:30 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:19:30 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:19:30 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:19:30 user nova-compute[76391]:       <nova:owner>
Nov 15 23:19:30 user nova-compute[76391]:         <nova:user uuid="9d5fb40133174f4db6f71696591de2a8">tempest-ServersNegativeTestJSON-686980340-project-member</nova:user>
Nov 15 23:19:30 user nova-compute[76391]:         <nova:project uuid="9bc691a9d5674fbb898dd6736e91613f">tempest-ServersNegativeTestJSON-686980340</nova:project>
Nov 15 23:19:30 user nova-compute[76391]:       </nova:owner>
Nov 15 23:19:30 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:19:30 user nova-compute[76391]:       <nova:ports>
Nov 15 23:19:30 user nova-compute[76391]:         <nova:port uuid="7c20a743-d1b7-49b9-b84d-f9b1e7262230">
Nov 15 23:19:30 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 23:19:30 user nova-compute[76391]:         </nova:port>
Nov 15 23:19:30 user nova-compute[76391]:       </nova:ports>
Nov 15 23:19:30 user nova-compute[76391]:     </nova:instance>
Nov 15 23:19:30 user nova-compute[76391]:   </metadata>
Nov 15 23:19:30 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:19:30 user nova-compute[76391]:     <system>
Nov 15 23:19:30 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:19:30 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:19:30 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:19:30 user nova-compute[76391]:       <entry name="serial">39cdf492-9c79-47f4-9437-aab5284b4dd3</entry>
Nov 15 23:19:30 user nova-compute[76391]:       <entry name="uuid">39cdf492-9c79-47f4-9437-aab5284b4dd3</entry>
Nov 15 23:19:30 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:19:30 user nova-compute[76391]:     </system>
Nov 15 23:19:30 user nova-compute[76391]:   </sysinfo>
Nov 15 23:19:30 user nova-compute[76391]:   <os>
Nov 15 23:19:30 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:19:30 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:19:30 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:19:30 user nova-compute[76391]:   </os>
Nov 15 23:19:30 user nova-compute[76391]:   <features>
Nov 15 23:19:30 user nova-compute[76391]:     <acpi/>
Nov 15 23:19:30 user nova-compute[76391]:     <apic/>
Nov 15 23:19:30 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:19:30 user nova-compute[76391]:   </features>
Nov 15 23:19:30 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:19:30 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:19:30 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:19:30 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:19:30 user nova-compute[76391]:   </clock>
Nov 15 23:19:30 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:19:30 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:19:30 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:19:30 user nova-compute[76391]:   </cpu>
Nov 15 23:19:30 user nova-compute[76391]:   <devices>
Nov 15 23:19:30 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:19:30 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:19:30 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk"/>
Nov 15 23:19:30 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:19:30 user nova-compute[76391]:     </disk>
Nov 15 23:19:30 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:19:30 user nova-compute[76391]:       <mac address="fa:16:3e:a2:a7:27"/>
Nov 15 23:19:30 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:30 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:19:30 user nova-compute[76391]:       <target dev="tap7c20a743-d1"/>
Nov 15 23:19:30 user nova-compute[76391]:     </interface>
Nov 15 23:19:30 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:19:30 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/console.log" append="off"/>
Nov 15 23:19:30 user nova-compute[76391]:     </serial>
Nov 15 23:19:30 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:19:30 user nova-compute[76391]:     <video>
Nov 15 23:19:30 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:19:30 user nova-compute[76391]:     </video>
Nov 15 23:19:30 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:19:30 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:19:30 user nova-compute[76391]:     </rng>
Nov 15 23:19:30 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:19:30 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:19:30 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:19:30 user nova-compute[76391]:     </memballoon>
Nov 15 23:19:30 user nova-compute[76391]:   </devices>
Nov 15 23:19:30 user nova-compute[76391]: </domain>
Nov 15 23:19:30 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1742095287',display_name='tempest-ServersNegativeTestJSON-server-1742095287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1742095287',id=19,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bc691a9d5674fbb898dd6736e91613f',ramdisk_id='',reservation_id='r-5xxovw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-686980340',owner_user_name='tempest-ServersNegativeTestJSON-686980340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:28Z,user_data=None,user_id='9d5fb40133174f4db6f71696591de2a8',uuid=39cdf492-9c79-47f4-9437-aab5284b4dd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converting VIF {"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c20a743-d1b7-49b9-b84d-f9b1e7262230,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c20a743-d1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG os_vif [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c20a743-d1b7-49b9-b84d-f9b1e7262230,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c20a743-d1') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:19:30 user nova-compute[76391]: INFO nova.compute.manager [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Took 1.98 seconds to destroy the instance on the hypervisor.
Nov 15 23:19:30 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a360425-6330-537e-87bd-c9a516176164', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:19:30 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c20a743-d1, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c20a743-d1, col_values=(('qos', UUID('6e4492e6-2820-4dcd-93a3-e663d0342461')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c20a743-d1, col_values=(('external_ids', {'iface-id': '7c20a743-d1b7-49b9-b84d-f9b1e7262230', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:a7:27', 'vm-uuid': '39cdf492-9c79-47f4-9437-aab5284b4dd3'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:31 user nova-compute[76391]: INFO os_vif [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c20a743-d1b7-49b9-b84d-f9b1e7262230,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c20a743-d1')
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] No VIF found with MAC fa:16:3e:a2:a7:27, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8e8266-0da9-474c-ad9e-3a0cf1075e39 req-759f3b5c-e3b1-47ac-b2de-67587e1bb4a4 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8e8266-0da9-474c-ad9e-3a0cf1075e39 req-759f3b5c-e3b1-47ac-b2de-67587e1bb4a4 service nova] Acquiring lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8e8266-0da9-474c-ad9e-3a0cf1075e39 req-759f3b5c-e3b1-47ac-b2de-67587e1bb4a4 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8e8266-0da9-474c-ad9e-3a0cf1075e39 req-759f3b5c-e3b1-47ac-b2de-67587e1bb4a4 service nova] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8e8266-0da9-474c-ad9e-3a0cf1075e39 req-759f3b5c-e3b1-47ac-b2de-67587e1bb4a4 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] No waiting events found dispatching network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:31 user nova-compute[76391]: WARNING nova.compute.manager [req-0e8e8266-0da9-474c-ad9e-3a0cf1075e39 req-759f3b5c-e3b1-47ac-b2de-67587e1bb4a4 service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received unexpected event network-vif-plugged-b09aad63-4edf-494c-808a-4b0472dfdd18 for instance with vm_state active and task_state deleting.
Nov 15 23:19:31 user nova-compute[76391]: DEBUG nova.network.neutron [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Updated VIF entry in instance network info cache for port 7c20a743-d1b7-49b9-b84d-f9b1e7262230. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG nova.network.neutron [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Updating instance_info_cache with network_info: [{"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f2325701-e6d4-4441-b0fb-9122cdb7aa1f req-cb2a097f-5cf7-470f-9afb-d73637f2b374 service nova] Releasing lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:32 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Took 1.26 seconds to deallocate network for instance.
Nov 15 23:19:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-6959e071-d32e-4e72-8a92-4ddc707f0202 req-372bc51c-5d4d-4b0a-b901-7fce146681ef service nova] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Received event network-vif-deleted-b09aad63-4edf-494c-808a-4b0472dfdd18 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:32 user nova-compute[76391]: WARNING nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state building and task_state spawning.
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:32 user nova-compute[76391]: WARNING nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state building and task_state spawning.
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received event network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] No waiting events found dispatching network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:32 user nova-compute[76391]: WARNING nova.compute.manager [req-ad9bc186-e9ea-4d82-98b2-d9a4da9409af req-93a09260-d88b-468e-a78a-483f0e5ac5a3 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received unexpected event network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 for instance with vm_state building and task_state spawning.
Nov 15 23:19:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:33 user nova-compute[76391]: INFO nova.compute.manager [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Took 1.06 seconds to detach 1 volumes for instance.
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] [instance: eb286b41-55ed-4a38-8e66-6edb5f0ccd0e] Deleting volume: fba4cc50-1dea-41a7-93f3-7c414425be67 {{(pid=76391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:19:33 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance spawned successfully.
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:33 user nova-compute[76391]: INFO nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Took 10.63 seconds to spawn the instance on the hypervisor.
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:19:33 user nova-compute[76391]: INFO nova.compute.manager [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Took 12.01 seconds to build instance.
Nov 15 23:19:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d9c197cd-7cf8-41ac-9116-2b2b508efb2e tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.142s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:33 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Deleted allocations for instance eb286b41-55ed-4a38-8e66-6edb5f0ccd0e
Nov 15 23:19:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-60d66847-606a-4236-b4ce-5c6beea93149 tempest-ServerActionsV293TestJSON-1456826566 tempest-ServerActionsV293TestJSON-1456826566-project-member] Lock "eb286b41-55ed-4a38-8e66-6edb5f0ccd0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.092s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:19:34 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance spawned successfully.
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:34 user nova-compute[76391]: INFO nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Took 10.14 seconds to spawn the instance on the hypervisor.
Nov 15 23:19:34 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:19:34 user nova-compute[76391]: INFO nova.compute.manager [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Took 11.36 seconds to build instance.
Nov 15 23:19:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ef4d0312-4a84-4d99-b861-eb18c7a950c2 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.525s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-79389daa-60ef-4a6c-b254-72c7ea03ebcb req-9a30b231-7d67-44db-ade3-f5f4528d87b1 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received event network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79389daa-60ef-4a6c-b254-72c7ea03ebcb req-9a30b231-7d67-44db-ade3-f5f4528d87b1 service nova] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79389daa-60ef-4a6c-b254-72c7ea03ebcb req-9a30b231-7d67-44db-ade3-f5f4528d87b1 service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79389daa-60ef-4a6c-b254-72c7ea03ebcb req-9a30b231-7d67-44db-ade3-f5f4528d87b1 service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-79389daa-60ef-4a6c-b254-72c7ea03ebcb req-9a30b231-7d67-44db-ade3-f5f4528d87b1 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] No waiting events found dispatching network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:35 user nova-compute[76391]: WARNING nova.compute.manager [req-79389daa-60ef-4a6c-b254-72c7ea03ebcb req-9a30b231-7d67-44db-ade3-f5f4528d87b1 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received unexpected event network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 for instance with vm_state building and task_state spawning.
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:19:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Instance spawned successfully.
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:19:35 user nova-compute[76391]: INFO nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Took 6.67 seconds to spawn the instance on the hypervisor.
Nov 15 23:19:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:19:35 user nova-compute[76391]: INFO nova.compute.manager [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Took 7.65 seconds to build instance.
Nov 15 23:19:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-81356e51-4e7b-40a8-8c54-9f19d72d936a tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.835s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:39 user nova-compute[76391]: INFO nova.compute.manager [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Terminating instance
Nov 15 23:19:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-b7f68e1d-519b-40b0-ab00-a145f3a6d017 req-6be2f9ec-357d-4678-b4a3-f12797985053 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-unplugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b7f68e1d-519b-40b0-ab00-a145f3a6d017 req-6be2f9ec-357d-4678-b4a3-f12797985053 service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b7f68e1d-519b-40b0-ab00-a145f3a6d017 req-6be2f9ec-357d-4678-b4a3-f12797985053 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b7f68e1d-519b-40b0-ab00-a145f3a6d017 req-6be2f9ec-357d-4678-b4a3-f12797985053 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-b7f68e1d-519b-40b0-ab00-a145f3a6d017 req-6be2f9ec-357d-4678-b4a3-f12797985053 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-unplugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-b7f68e1d-519b-40b0-ab00-a145f3a6d017 req-6be2f9ec-357d-4678-b4a3-f12797985053 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-unplugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:19:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Instance destroyed successfully.
Nov 15 23:19:40 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lazy-loading 'resources' on Instance uuid 0e649109-ec27-45b9-93ca-ee6bddf5d0d8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1567180745',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1567180745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1567180',id=12,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAevNfUbqTIX8ztZ2tuAO47jc7heZSRBQbVCVxVQIT5enOfOPZLlzPUYAAmF7iTPJUrWktN9Yj3oyb/bhE6GcgjoaOF1eak+rzDzeJqJCQv3KK9hklPGBFWFLmOL0sapoA==',key_name='tempest-keypair-439551556',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96b51dba573d4c5ea3046cf8a8da8622',ramdisk_id='',reservation_id='r-rt7s0o0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1608108478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65c76575aecb4eb9a883db483c842a50',uuid=0e649109-ec27-45b9-93ca-ee6bddf5d0d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Converting VIF {"id": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "address": "fa:16:3e:0b:a2:8e", "network": {"id": "342da2a8-91f5-4e4a-8352-a67399f2ff08", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-829578369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96b51dba573d4c5ea3046cf8a8da8622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a59c58d-9c", "ovs_interfaceid": "2a59c58d-9ce8-4450-9287-d8605f63d82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=2a59c58d-9ce8-4450-9287-d8605f63d82b,network=Network(342da2a8-91f5-4e4a-8352-a67399f2ff08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a59c58d-9c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG os_vif [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=2a59c58d-9ce8-4450-9287-d8605f63d82b,network=Network(342da2a8-91f5-4e4a-8352-a67399f2ff08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a59c58d-9c') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a59c58d-9c, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf568e97-a87e-4b20-a71f-fe9a6890a8c4) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:19:40 user nova-compute[76391]: INFO os_vif [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=2a59c58d-9ce8-4450-9287-d8605f63d82b,network=Network(342da2a8-91f5-4e4a-8352-a67399f2ff08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a59c58d-9c')
Nov 15 23:19:40 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Deleting instance files /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8_del
Nov 15 23:19:40 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Deletion of /opt/stack/data/nova/instances/0e649109-ec27-45b9-93ca-ee6bddf5d0d8_del complete
Nov 15 23:19:40 user nova-compute[76391]: INFO nova.compute.manager [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 15 23:19:40 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:19:40 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:42 user nova-compute[76391]: WARNING nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received unexpected event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with vm_state active and task_state deleting.
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:42 user nova-compute[76391]: WARNING nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received unexpected event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with vm_state active and task_state deleting.
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:42 user nova-compute[76391]: WARNING nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received unexpected event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with vm_state active and task_state deleting.
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-unplugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-unplugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-76f9040c-56fe-4e1a-a498-6d409519c67e req-834a5b80-187a-4207-9a2e-a982c46f7eb3 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-unplugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:19:42 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Took 1.40 seconds to deallocate network for instance.
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:19:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:42 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Deleted allocations for instance 0e649109-ec27-45b9-93ca-ee6bddf5d0d8
Nov 15 23:19:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9679ecf9-1268-4500-ae58-4c6ac1128940 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478 tempest-TestServerVolumeAttachScenarioOldVersion-1608108478-project-member] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.402s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-62177086-7ea3-4ce7-a27c-4dfc8b47b9ff req-649f81c4-3e43-421b-9ce9-abc377759811 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-62177086-7ea3-4ce7-a27c-4dfc8b47b9ff req-649f81c4-3e43-421b-9ce9-abc377759811 service nova] Acquiring lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:19:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-62177086-7ea3-4ce7-a27c-4dfc8b47b9ff req-649f81c4-3e43-421b-9ce9-abc377759811 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:19:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-62177086-7ea3-4ce7-a27c-4dfc8b47b9ff req-649f81c4-3e43-421b-9ce9-abc377759811 service nova] Lock "0e649109-ec27-45b9-93ca-ee6bddf5d0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:19:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-62177086-7ea3-4ce7-a27c-4dfc8b47b9ff req-649f81c4-3e43-421b-9ce9-abc377759811 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] No waiting events found dispatching network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:19:44 user nova-compute[76391]: WARNING nova.compute.manager [req-62177086-7ea3-4ce7-a27c-4dfc8b47b9ff req-649f81c4-3e43-421b-9ce9-abc377759811 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received unexpected event network-vif-plugged-2a59c58d-9ce8-4450-9287-d8605f63d82b for instance with vm_state deleted and task_state None.
Nov 15 23:19:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-62177086-7ea3-4ce7-a27c-4dfc8b47b9ff req-649f81c4-3e43-421b-9ce9-abc377759811 service nova] [instance: 0e649109-ec27-45b9-93ca-ee6bddf5d0d8] Received event network-vif-deleted-2a59c58d-9ce8-4450-9287-d8605f63d82b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:19:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:19:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:20:12 user nova-compute[76391]: INFO nova.compute.claims [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Claim successful on node user
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:20:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.policy [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0c9e701d0284b2aa0e84377caa58bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e1038cf1945748b7330846501a7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:20:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Creating image(s)
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "/opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "/opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "/opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk 1073741824" returned: 0 in 0.050s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.222s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Successfully created port: d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Cannot resize image /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Ensure instance console log exists: /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Successfully updated port: d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "refresh_cache-d16e63a2-95bb-4709-960b-9518f4eb82e5" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquired lock "refresh_cache-d16e63a2-95bb-4709-960b-9518f4eb82e5" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received event network-changed-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Refreshing instance network info cache due to event network-changed-d5454cae-68f5-4e35-ad54-9fc20f309d1e. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] Acquiring lock "refresh_cache-d16e63a2-95bb-4709-960b-9518f4eb82e5" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:15 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Updating instance_info_cache with network_info: [{"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Releasing lock "refresh_cache-d16e63a2-95bb-4709-960b-9518f4eb82e5" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Instance network_info: |[{"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] Acquired lock "refresh_cache-d16e63a2-95bb-4709-960b-9518f4eb82e5" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Refreshing network info cache for port d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Start _get_guest_xml network_info=[{"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:20:16 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:16 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-983976004',display_name='tempest-DeleteServersTestJSON-server-983976004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-983976004',id=20,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='935e1038cf1945748b7330846501a7f8',ramdisk_id='',reservation_id='r-3l0b2f7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2070975080',owner_user_name='tempest-DeleteServersTestJSON-2070975080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:14Z,user_data=None,user_id='d0c9e701d0284b2aa0e84377caa58bdd',uuid=d16e63a2-95bb-4709-960b-9518f4eb82e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Converting VIF {"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:83,bridge_name='br-int',has_traffic_filtering=True,id=d5454cae-68f5-4e35-ad54-9fc20f309d1e,network=Network(2e874fe1-93bf-428f-a0cf-c1a5f25f9248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5454cae-68') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lazy-loading 'pci_devices' on Instance uuid d16e63a2-95bb-4709-960b-9518f4eb82e5 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:20:16 user nova-compute[76391]:   <uuid>d16e63a2-95bb-4709-960b-9518f4eb82e5</uuid>
Nov 15 23:20:16 user nova-compute[76391]:   <name>instance-00000014</name>
Nov 15 23:20:16 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:20:16 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:20:16 user nova-compute[76391]:   <metadata>
Nov 15 23:20:16 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:20:16 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:20:16 user nova-compute[76391]:       <nova:name>tempest-DeleteServersTestJSON-server-983976004</nova:name>
Nov 15 23:20:16 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:20:16</nova:creationTime>
Nov 15 23:20:16 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:20:16 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:20:16 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:20:16 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:20:16 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:20:16 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:20:16 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:20:16 user nova-compute[76391]:       <nova:owner>
Nov 15 23:20:16 user nova-compute[76391]:         <nova:user uuid="d0c9e701d0284b2aa0e84377caa58bdd">tempest-DeleteServersTestJSON-2070975080-project-member</nova:user>
Nov 15 23:20:16 user nova-compute[76391]:         <nova:project uuid="935e1038cf1945748b7330846501a7f8">tempest-DeleteServersTestJSON-2070975080</nova:project>
Nov 15 23:20:16 user nova-compute[76391]:       </nova:owner>
Nov 15 23:20:16 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:20:16 user nova-compute[76391]:       <nova:ports>
Nov 15 23:20:16 user nova-compute[76391]:         <nova:port uuid="d5454cae-68f5-4e35-ad54-9fc20f309d1e">
Nov 15 23:20:16 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 23:20:16 user nova-compute[76391]:         </nova:port>
Nov 15 23:20:16 user nova-compute[76391]:       </nova:ports>
Nov 15 23:20:16 user nova-compute[76391]:     </nova:instance>
Nov 15 23:20:16 user nova-compute[76391]:   </metadata>
Nov 15 23:20:16 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:20:16 user nova-compute[76391]:     <system>
Nov 15 23:20:16 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:20:16 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:20:16 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:20:16 user nova-compute[76391]:       <entry name="serial">d16e63a2-95bb-4709-960b-9518f4eb82e5</entry>
Nov 15 23:20:16 user nova-compute[76391]:       <entry name="uuid">d16e63a2-95bb-4709-960b-9518f4eb82e5</entry>
Nov 15 23:20:16 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:20:16 user nova-compute[76391]:     </system>
Nov 15 23:20:16 user nova-compute[76391]:   </sysinfo>
Nov 15 23:20:16 user nova-compute[76391]:   <os>
Nov 15 23:20:16 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:20:16 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:20:16 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:20:16 user nova-compute[76391]:   </os>
Nov 15 23:20:16 user nova-compute[76391]:   <features>
Nov 15 23:20:16 user nova-compute[76391]:     <acpi/>
Nov 15 23:20:16 user nova-compute[76391]:     <apic/>
Nov 15 23:20:16 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:20:16 user nova-compute[76391]:   </features>
Nov 15 23:20:16 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:20:16 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:20:16 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:20:16 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:20:16 user nova-compute[76391]:   </clock>
Nov 15 23:20:16 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:20:16 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:20:16 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:20:16 user nova-compute[76391]:   </cpu>
Nov 15 23:20:16 user nova-compute[76391]:   <devices>
Nov 15 23:20:16 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:20:16 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:20:16 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk"/>
Nov 15 23:20:16 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:20:16 user nova-compute[76391]:     </disk>
Nov 15 23:20:16 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:20:16 user nova-compute[76391]:       <mac address="fa:16:3e:5c:58:83"/>
Nov 15 23:20:16 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:16 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:20:16 user nova-compute[76391]:       <target dev="tapd5454cae-68"/>
Nov 15 23:20:16 user nova-compute[76391]:     </interface>
Nov 15 23:20:16 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:20:16 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/console.log" append="off"/>
Nov 15 23:20:16 user nova-compute[76391]:     </serial>
Nov 15 23:20:16 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:20:16 user nova-compute[76391]:     <video>
Nov 15 23:20:16 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:16 user nova-compute[76391]:     </video>
Nov 15 23:20:16 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:20:16 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:20:16 user nova-compute[76391]:     </rng>
Nov 15 23:20:16 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:20:16 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:20:16 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:20:16 user nova-compute[76391]:     </memballoon>
Nov 15 23:20:16 user nova-compute[76391]:   </devices>
Nov 15 23:20:16 user nova-compute[76391]: </domain>
Nov 15 23:20:16 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-983976004',display_name='tempest-DeleteServersTestJSON-server-983976004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-983976004',id=20,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='935e1038cf1945748b7330846501a7f8',ramdisk_id='',reservation_id='r-3l0b2f7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2070975080',owner_user_name='tempest-DeleteServersTestJSON-2070975080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:14Z,user_data=None,user_id='d0c9e701d0284b2aa0e84377caa58bdd',uuid=d16e63a2-95bb-4709-960b-9518f4eb82e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Converting VIF {"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:83,bridge_name='br-int',has_traffic_filtering=True,id=d5454cae-68f5-4e35-ad54-9fc20f309d1e,network=Network(2e874fe1-93bf-428f-a0cf-c1a5f25f9248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5454cae-68') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG os_vif [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:83,bridge_name='br-int',has_traffic_filtering=True,id=d5454cae-68f5-4e35-ad54-9fc20f309d1e,network=Network(2e874fe1-93bf-428f-a0cf-c1a5f25f9248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5454cae-68') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4f00ec3-a800-5325-b52f-e97156f0c5d8', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5454cae-68, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5454cae-68, col_values=(('qos', UUID('d40888f7-f125-4a96-840c-0c226d7b5a97')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5454cae-68, col_values=(('external_ids', {'iface-id': 'd5454cae-68f5-4e35-ad54-9fc20f309d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:58:83', 'vm-uuid': 'd16e63a2-95bb-4709-960b-9518f4eb82e5'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:16 user nova-compute[76391]: INFO os_vif [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:83,bridge_name='br-int',has_traffic_filtering=True,id=d5454cae-68f5-4e35-ad54-9fc20f309d1e,network=Network(2e874fe1-93bf-428f-a0cf-c1a5f25f9248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5454cae-68')
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:20:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] No VIF found with MAC fa:16:3e:5c:58:83, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG nova.network.neutron [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Updated VIF entry in instance network info cache for port d5454cae-68f5-4e35-ad54-9fc20f309d1e. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG nova.network.neutron [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Updating instance_info_cache with network_info: [{"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3354d158-4c25-49a8-99e5-07ce7c39335b req-2f0d42b3-aeda-4c66-8cf2-783bd96174c9 service nova] Releasing lock "refresh_cache-d16e63a2-95bb-4709-960b-9518f4eb82e5" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:17 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:20:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:20:20 user nova-compute[76391]: INFO nova.compute.claims [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Claim successful on node user
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:20:21 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Instance spawned successfully.
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:21 user nova-compute[76391]: INFO nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:21 user nova-compute[76391]: INFO nova.compute.manager [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Took 8.54 seconds to build instance.
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ed3f2f35-9a27-47c2-a151-1a06b8c1534f tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.665s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.manager [req-a0d8966d-fb6a-430b-becf-094b8e0e45d7 req-f2e1367a-ec41-44a5-80fc-cc52dfa76da2 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received event network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a0d8966d-fb6a-430b-becf-094b8e0e45d7 req-f2e1367a-ec41-44a5-80fc-cc52dfa76da2 service nova] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a0d8966d-fb6a-430b-becf-094b8e0e45d7 req-f2e1367a-ec41-44a5-80fc-cc52dfa76da2 service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a0d8966d-fb6a-430b-becf-094b8e0e45d7 req-f2e1367a-ec41-44a5-80fc-cc52dfa76da2 service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.manager [req-a0d8966d-fb6a-430b-becf-094b8e0e45d7 req-f2e1367a-ec41-44a5-80fc-cc52dfa76da2 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] No waiting events found dispatching network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:21 user nova-compute[76391]: WARNING nova.compute.manager [req-a0d8966d-fb6a-430b-becf-094b8e0e45d7 req-f2e1367a-ec41-44a5-80fc-cc52dfa76da2 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received unexpected event network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e for instance with vm_state active and task_state None.
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.875s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.network.neutron [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:20:21 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:20:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:20:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Creating image(s)
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.policy [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8130ccbe83bf4c5cbc4698cd64b0007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55551c07142e448bb6111c0c35fb3ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk 1073741824" returned: 0 in 0.054s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Cannot resize image /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Ensure instance console log exists: /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:20:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Successfully created port: 15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:20:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Successfully updated port: 15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-2427d9f9-e6b0-44b2-952a-dd30bff25273 req-811f430e-1d18-4e08-967c-87b4f0fa0276 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received event network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2427d9f9-e6b0-44b2-952a-dd30bff25273 req-811f430e-1d18-4e08-967c-87b4f0fa0276 service nova] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2427d9f9-e6b0-44b2-952a-dd30bff25273 req-811f430e-1d18-4e08-967c-87b4f0fa0276 service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2427d9f9-e6b0-44b2-952a-dd30bff25273 req-811f430e-1d18-4e08-967c-87b4f0fa0276 service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-2427d9f9-e6b0-44b2-952a-dd30bff25273 req-811f430e-1d18-4e08-967c-87b4f0fa0276 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] No waiting events found dispatching network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:24 user nova-compute[76391]: WARNING nova.compute.manager [req-2427d9f9-e6b0-44b2-952a-dd30bff25273 req-811f430e-1d18-4e08-967c-87b4f0fa0276 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received unexpected event network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e for instance with vm_state active and task_state None.
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing instance network info cache due to event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] Acquiring lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] Acquired lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing network info cache for port 15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:24 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:24 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7263MB free_disk=25.386241912841797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e08c5f26-850b-4d4a-89ab-88f2066acc71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d16e63a2-95bb-4709-960b-9518f4eb82e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-abf6c54a-5529-4c1b-bd6c-46d2485e45af req-01fb2772-3cbc-481b-b184-7bc6b11d00f0 service nova] Releasing lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquired lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.781s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.674s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:24 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:20:24 user nova-compute[76391]: INFO nova.compute.claims [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Claim successful on node user
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Releasing lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance network_info: |[{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Start _get_guest_xml network_info=[{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:20:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-408591733',display_name='tempest-ServerStableDeviceRescueTest-server-408591733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-408591733',id=21,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJqUpSw/TXkHYm7b4bi08C4AfmdJoxvyVGSic+nhrsDXAssxcuasdq+Orfi/R/2gDVO9en5VTOxxybZiTZ8R5ELr9EXaWXDSiGrH03qbtjWWkRDaJhwFhf0qHbJeiSf8A==',key_name='tempest-keypair-729520390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55551c07142e448bb6111c0c35fb3ee0',ramdisk_id='',reservation_id='r-m52hfv3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-802850774',owner_user_name='tempest-ServerStableDeviceRescueTest-802850774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8130ccbe83bf4c5cbc4698cd64b0007a',uuid=53814dee-eafa-4742-9888-2bfcafa5ee91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converting VIF {"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.objects.instance [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'pci_devices' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:20:25 user nova-compute[76391]:   <uuid>53814dee-eafa-4742-9888-2bfcafa5ee91</uuid>
Nov 15 23:20:25 user nova-compute[76391]:   <name>instance-00000015</name>
Nov 15 23:20:25 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:20:25 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:20:25 user nova-compute[76391]:   <metadata>
Nov 15 23:20:25 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:20:25 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:20:25 user nova-compute[76391]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-408591733</nova:name>
Nov 15 23:20:25 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:20:25</nova:creationTime>
Nov 15 23:20:25 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:20:25 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:20:25 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:20:25 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:20:25 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:20:25 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:20:25 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:20:25 user nova-compute[76391]:       <nova:owner>
Nov 15 23:20:25 user nova-compute[76391]:         <nova:user uuid="8130ccbe83bf4c5cbc4698cd64b0007a">tempest-ServerStableDeviceRescueTest-802850774-project-member</nova:user>
Nov 15 23:20:25 user nova-compute[76391]:         <nova:project uuid="55551c07142e448bb6111c0c35fb3ee0">tempest-ServerStableDeviceRescueTest-802850774</nova:project>
Nov 15 23:20:25 user nova-compute[76391]:       </nova:owner>
Nov 15 23:20:25 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:20:25 user nova-compute[76391]:       <nova:ports>
Nov 15 23:20:25 user nova-compute[76391]:         <nova:port uuid="15463d4f-33b1-488b-85a6-ba2d5c15c10b">
Nov 15 23:20:25 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 23:20:25 user nova-compute[76391]:         </nova:port>
Nov 15 23:20:25 user nova-compute[76391]:       </nova:ports>
Nov 15 23:20:25 user nova-compute[76391]:     </nova:instance>
Nov 15 23:20:25 user nova-compute[76391]:   </metadata>
Nov 15 23:20:25 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:20:25 user nova-compute[76391]:     <system>
Nov 15 23:20:25 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:20:25 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:20:25 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:20:25 user nova-compute[76391]:       <entry name="serial">53814dee-eafa-4742-9888-2bfcafa5ee91</entry>
Nov 15 23:20:25 user nova-compute[76391]:       <entry name="uuid">53814dee-eafa-4742-9888-2bfcafa5ee91</entry>
Nov 15 23:20:25 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:20:25 user nova-compute[76391]:     </system>
Nov 15 23:20:25 user nova-compute[76391]:   </sysinfo>
Nov 15 23:20:25 user nova-compute[76391]:   <os>
Nov 15 23:20:25 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:20:25 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:20:25 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:20:25 user nova-compute[76391]:   </os>
Nov 15 23:20:25 user nova-compute[76391]:   <features>
Nov 15 23:20:25 user nova-compute[76391]:     <acpi/>
Nov 15 23:20:25 user nova-compute[76391]:     <apic/>
Nov 15 23:20:25 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:20:25 user nova-compute[76391]:   </features>
Nov 15 23:20:25 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:20:25 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:20:25 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:20:25 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:20:25 user nova-compute[76391]:   </clock>
Nov 15 23:20:25 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:20:25 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:20:25 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:20:25 user nova-compute[76391]:   </cpu>
Nov 15 23:20:25 user nova-compute[76391]:   <devices>
Nov 15 23:20:25 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:20:25 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:20:25 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk"/>
Nov 15 23:20:25 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:20:25 user nova-compute[76391]:     </disk>
Nov 15 23:20:25 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:20:25 user nova-compute[76391]:       <mac address="fa:16:3e:c9:73:56"/>
Nov 15 23:20:25 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:25 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:20:25 user nova-compute[76391]:       <target dev="tap15463d4f-33"/>
Nov 15 23:20:25 user nova-compute[76391]:     </interface>
Nov 15 23:20:25 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:20:25 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/console.log" append="off"/>
Nov 15 23:20:25 user nova-compute[76391]:     </serial>
Nov 15 23:20:25 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:20:25 user nova-compute[76391]:     <video>
Nov 15 23:20:25 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:25 user nova-compute[76391]:     </video>
Nov 15 23:20:25 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:20:25 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:20:25 user nova-compute[76391]:     </rng>
Nov 15 23:20:25 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:20:25 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:20:25 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:20:25 user nova-compute[76391]:     </memballoon>
Nov 15 23:20:25 user nova-compute[76391]:   </devices>
Nov 15 23:20:25 user nova-compute[76391]: </domain>
Nov 15 23:20:25 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-408591733',display_name='tempest-ServerStableDeviceRescueTest-server-408591733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-408591733',id=21,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJqUpSw/TXkHYm7b4bi08C4AfmdJoxvyVGSic+nhrsDXAssxcuasdq+Orfi/R/2gDVO9en5VTOxxybZiTZ8R5ELr9EXaWXDSiGrH03qbtjWWkRDaJhwFhf0qHbJeiSf8A==',key_name='tempest-keypair-729520390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55551c07142e448bb6111c0c35fb3ee0',ramdisk_id='',reservation_id='r-m52hfv3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-802850774',owner_user_name='tempest-ServerStableDeviceRescueTest-802850774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8130ccbe83bf4c5cbc4698cd64b0007a',uuid=53814dee-eafa-4742-9888-2bfcafa5ee91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converting VIF {"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG os_vif [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c53cf6a8-720b-58c6-bb30-43d94fa1d025', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15463d4f-33, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15463d4f-33, col_values=(('qos', UUID('5a647381-5bb6-4474-beb3-b612da47fe6e')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15463d4f-33, col_values=(('external_ids', {'iface-id': '15463d4f-33b1-488b-85a6-ba2d5c15c10b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:73:56', 'vm-uuid': '53814dee-eafa-4742-9888-2bfcafa5ee91'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:25 user nova-compute[76391]: INFO os_vif [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33')
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No VIF found with MAC fa:16:3e:c9:73:56, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:20:25 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.policy [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a246bfc3bf184459b37f06965c15b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ad6f3dde3a4b8b9a78f79cebabd970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:20:25 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Creating image(s)
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:20:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.264s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:26 user nova-compute[76391]: INFO nova.compute.manager [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Terminating instance
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:26 user nova-compute[76391]: INFO nova.compute.manager [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Terminating instance
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.243s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk 1073741824" returned: 0 in 0.091s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-d08baee8-43b2-48a4-8923-d0c1ac094a62 req-4fc8e117-c056-4c60-b9a9-781365984cba service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received event network-vif-unplugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d08baee8-43b2-48a4-8923-d0c1ac094a62 req-4fc8e117-c056-4c60-b9a9-781365984cba service nova] Acquiring lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d08baee8-43b2-48a4-8923-d0c1ac094a62 req-4fc8e117-c056-4c60-b9a9-781365984cba service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d08baee8-43b2-48a4-8923-d0c1ac094a62 req-4fc8e117-c056-4c60-b9a9-781365984cba service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-d08baee8-43b2-48a4-8923-d0c1ac094a62 req-4fc8e117-c056-4c60-b9a9-781365984cba service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] No waiting events found dispatching network-vif-unplugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-d08baee8-43b2-48a4-8923-d0c1ac094a62 req-4fc8e117-c056-4c60-b9a9-781365984cba service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received event network-vif-unplugged-3917e5e4-7891-45d1-b015-20127d3fe142 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.222s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-4d78af96-7f72-45a7-a379-2be16afb3341 req-c0449ce9-849f-4cf5-89f6-182bd9968fed service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received event network-vif-unplugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4d78af96-7f72-45a7-a379-2be16afb3341 req-c0449ce9-849f-4cf5-89f6-182bd9968fed service nova] Acquiring lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4d78af96-7f72-45a7-a379-2be16afb3341 req-c0449ce9-849f-4cf5-89f6-182bd9968fed service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4d78af96-7f72-45a7-a379-2be16afb3341 req-c0449ce9-849f-4cf5-89f6-182bd9968fed service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-4d78af96-7f72-45a7-a379-2be16afb3341 req-c0449ce9-849f-4cf5-89f6-182bd9968fed service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] No waiting events found dispatching network-vif-unplugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-4d78af96-7f72-45a7-a379-2be16afb3341 req-c0449ce9-849f-4cf5-89f6-182bd9968fed service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received event network-vif-unplugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Cannot resize image /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Ensure instance console log exists: /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Successfully created port: f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Successfully updated port: f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquired lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Instance destroyed successfully.
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lazy-loading 'resources' on Instance uuid 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2110278607',display_name='tempest-VolumesActionsTest-instance-2110278607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2110278607',id=14,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:18:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5841417a1d4439c8059c788533b08b9',ramdisk_id='',reservation_id='r-c38j09ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1618594309',owner_user_name='tempest-VolumesActionsTest-1618594309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:18:42Z,user_data=None,user_id='2af794740660401081cf6d7e38289bd0',uuid=4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converting VIF {"id": "3917e5e4-7891-45d1-b015-20127d3fe142", "address": "fa:16:3e:ed:29:cd", "network": {"id": "6279cb69-a756-4ed5-8753-6eb918401f93", "bridge": "br-int", "label": "tempest-VolumesActionsTest-413276072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5841417a1d4439c8059c788533b08b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3917e5e4-78", "ovs_interfaceid": "3917e5e4-7891-45d1-b015-20127d3fe142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=3917e5e4-7891-45d1-b015-20127d3fe142,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3917e5e4-78') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG os_vif [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=3917e5e4-7891-45d1-b015-20127d3fe142,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3917e5e4-78') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3917e5e4-78, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Instance destroyed successfully.
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.objects.instance [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lazy-loading 'resources' on Instance uuid ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d681900-a01e-4782-8777-dc8a8cff4faf) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-102435708',display_name='tempest-VolumesAdminNegativeTest-server-102435708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-102435708',id=13,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:18:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36a5adda4e479884daa83ddb23d9da',ramdisk_id='',reservation_id='r-0vnwzon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2137202579',owner_user_name='tempest-VolumesAdminNegativeTest-2137202579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:18:39Z,user_data=None,user_id='a69f501c85d14ba9a335d49127b2e534',uuid=ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converting VIF {"id": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "address": "fa:16:3e:3d:fa:da", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e8bd-3b", "ovs_interfaceid": "c051e8bd-3bf8-4286-9394-7235ff5b47ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fa:da,bridge_name='br-int',has_traffic_filtering=True,id=c051e8bd-3bf8-4286-9394-7235ff5b47ac,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e8bd-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG os_vif [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fa:da,bridge_name='br-int',has_traffic_filtering=True,id=c051e8bd-3bf8-4286-9394-7235ff5b47ac,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e8bd-3b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc051e8bd-3b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: INFO os_vif [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=3917e5e4-7891-45d1-b015-20127d3fe142,network=Network(6279cb69-a756-4ed5-8753-6eb918401f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3917e5e4-78')
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Deleting instance files /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3_del
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Deletion of /opt/stack/data/nova/instances/4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3_del complete
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c50ffef-8a43-4924-abdc-2449a973b922) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: INFO os_vif [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fa:da,bridge_name='br-int',has_traffic_filtering=True,id=c051e8bd-3bf8-4286-9394-7235ff5b47ac,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e8bd-3b')
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Deleting instance files /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11_del
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Deletion of /opt/stack/data/nova/instances/ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11_del complete
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Releasing lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance network_info: |[{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Start _get_guest_xml network_info=[{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.compute.manager [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Took 1.94 seconds to destroy the instance on the hypervisor.
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:20:28 user nova-compute[76391]: INFO nova.compute.manager [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Took 1.97 seconds to destroy the instance on the hypervisor.
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:20:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.objects.instance [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lazy-loading 'pci_devices' on Instance uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:20:28 user nova-compute[76391]:   <uuid>39b01e2d-c7e1-4fb0-a184-088120332b4f</uuid>
Nov 15 23:20:28 user nova-compute[76391]:   <name>instance-00000016</name>
Nov 15 23:20:28 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:20:28 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:20:28 user nova-compute[76391]:   <metadata>
Nov 15 23:20:28 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:20:28 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:20:28 user nova-compute[76391]:       <nova:name>tempest-ServerActionsTestOtherB-server-1479706453</nova:name>
Nov 15 23:20:28 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:20:28</nova:creationTime>
Nov 15 23:20:28 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:20:28 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:20:28 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:20:28 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:20:28 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:20:28 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:20:28 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:20:28 user nova-compute[76391]:       <nova:owner>
Nov 15 23:20:28 user nova-compute[76391]:         <nova:user uuid="a246bfc3bf184459b37f06965c15b77b">tempest-ServerActionsTestOtherB-518662408-project-member</nova:user>
Nov 15 23:20:28 user nova-compute[76391]:         <nova:project uuid="e3ad6f3dde3a4b8b9a78f79cebabd970">tempest-ServerActionsTestOtherB-518662408</nova:project>
Nov 15 23:20:28 user nova-compute[76391]:       </nova:owner>
Nov 15 23:20:28 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:20:28 user nova-compute[76391]:       <nova:ports>
Nov 15 23:20:28 user nova-compute[76391]:         <nova:port uuid="f6e3d304-aa96-4149-9ea5-9fb21f718c1c">
Nov 15 23:20:28 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:20:28 user nova-compute[76391]:         </nova:port>
Nov 15 23:20:28 user nova-compute[76391]:       </nova:ports>
Nov 15 23:20:28 user nova-compute[76391]:     </nova:instance>
Nov 15 23:20:28 user nova-compute[76391]:   </metadata>
Nov 15 23:20:28 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:20:28 user nova-compute[76391]:     <system>
Nov 15 23:20:28 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:20:28 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:20:28 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:20:28 user nova-compute[76391]:       <entry name="serial">39b01e2d-c7e1-4fb0-a184-088120332b4f</entry>
Nov 15 23:20:28 user nova-compute[76391]:       <entry name="uuid">39b01e2d-c7e1-4fb0-a184-088120332b4f</entry>
Nov 15 23:20:28 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:20:28 user nova-compute[76391]:     </system>
Nov 15 23:20:28 user nova-compute[76391]:   </sysinfo>
Nov 15 23:20:28 user nova-compute[76391]:   <os>
Nov 15 23:20:28 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:20:28 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:20:28 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:20:28 user nova-compute[76391]:   </os>
Nov 15 23:20:28 user nova-compute[76391]:   <features>
Nov 15 23:20:28 user nova-compute[76391]:     <acpi/>
Nov 15 23:20:28 user nova-compute[76391]:     <apic/>
Nov 15 23:20:28 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:20:28 user nova-compute[76391]:   </features>
Nov 15 23:20:28 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:20:28 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:20:28 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:20:28 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:20:28 user nova-compute[76391]:   </clock>
Nov 15 23:20:28 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:20:28 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:20:28 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:20:28 user nova-compute[76391]:   </cpu>
Nov 15 23:20:28 user nova-compute[76391]:   <devices>
Nov 15 23:20:28 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:20:28 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:20:28 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk"/>
Nov 15 23:20:28 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:20:28 user nova-compute[76391]:     </disk>
Nov 15 23:20:28 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:20:28 user nova-compute[76391]:       <mac address="fa:16:3e:0c:74:2a"/>
Nov 15 23:20:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:28 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:20:28 user nova-compute[76391]:       <target dev="tapf6e3d304-aa"/>
Nov 15 23:20:28 user nova-compute[76391]:     </interface>
Nov 15 23:20:28 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:20:28 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/console.log" append="off"/>
Nov 15 23:20:28 user nova-compute[76391]:     </serial>
Nov 15 23:20:28 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:20:28 user nova-compute[76391]:     <video>
Nov 15 23:20:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:28 user nova-compute[76391]:     </video>
Nov 15 23:20:28 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:20:28 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:20:28 user nova-compute[76391]:     </rng>
Nov 15 23:20:28 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:20:28 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:20:28 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:20:28 user nova-compute[76391]:     </memballoon>
Nov 15 23:20:28 user nova-compute[76391]:   </devices>
Nov 15 23:20:28 user nova-compute[76391]: </domain>
Nov 15 23:20:28 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG os_vif [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41fd8a32-d8e8-5b6b-8cc7-f4cc31ffba48', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6e3d304-aa, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6e3d304-aa, col_values=(('qos', UUID('aa9b9d9d-0c20-463c-8e58-9872aa46f650')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6e3d304-aa, col_values=(('external_ids', {'iface-id': 'f6e3d304-aa96-4149-9ea5-9fb21f718c1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:74:2a', 'vm-uuid': '39b01e2d-c7e1-4fb0-a184-088120332b4f'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:28 user nova-compute[76391]: INFO os_vif [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa')
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No VIF found with MAC fa:16:3e:0c:74:2a, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received event network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Acquiring lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] No waiting events found dispatching network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:28 user nova-compute[76391]: WARNING nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received unexpected event network-vif-plugged-3917e5e4-7891-45d1-b015-20127d3fe142 for instance with vm_state active and task_state deleting.
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:28 user nova-compute[76391]: WARNING nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state building and task_state spawning.
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:28 user nova-compute[76391]: WARNING nova.compute.manager [req-db07356f-369a-49a4-b350-fe4bab363f7e req-3fef1f4b-c846-4b84-89ad-ebc534492338 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state building and task_state spawning.
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received event network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] Acquiring lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] No waiting events found dispatching network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:29 user nova-compute[76391]: WARNING nova.compute.manager [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received unexpected event network-vif-plugged-c051e8bd-3bf8-4286-9394-7235ff5b47ac for instance with vm_state active and task_state deleting.
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-changed-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Refreshing instance network info cache due to event network-changed-f6e3d304-aa96-4149-9ea5-9fb21f718c1c. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] Acquiring lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] Acquired lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Refreshing network info cache for port f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:29 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Took 1.10 seconds to deallocate network for instance.
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:29 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Took 1.28 seconds to deallocate network for instance.
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updated VIF entry in instance network info cache for port f6e3d304-aa96-4149-9ea5-9fb21f718c1c. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aedc1dad-d065-4ca9-a6c4-87c72a017b06 req-4f21a66e-3baa-499f-95ae-29c0d63bea31 service nova] Releasing lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:29 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.456s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:30 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Deleted allocations for instance ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:20:30 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance spawned successfully.
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71183e95-b5ab-49ce-9be7-bdac36507af2 tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.047s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:30 user nova-compute[76391]: INFO nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Took 8.42 seconds to spawn the instance on the hypervisor.
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:20:30 user nova-compute[76391]: INFO nova.compute.manager [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Took 9.87 seconds to build instance.
Nov 15 23:20:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-caac4f40-60b9-4a8f-9396-b206112adae4 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.083s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.844s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:30 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Deleted allocations for instance 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3
Nov 15 23:20:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c2b9fa28-db87-4d06-867a-8bf4e7b59f4f tempest-VolumesActionsTest-1618594309 tempest-VolumesActionsTest-1618594309-project-member] Lock "4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.810s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:31 user nova-compute[76391]: WARNING nova.compute.manager [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state building and task_state spawning.
Nov 15 23:20:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:31 user nova-compute[76391]: WARNING nova.compute.manager [req-42245da8-87cf-4cf2-8201-cb72e912de7e req-208d0bb1-96de-4eda-9c92-50f8bfc7ffa5 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state building and task_state spawning.
Nov 15 23:20:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a3a0c87-802b-4d9f-bb96-1d2b65c2919e req-7beaa164-511b-42d9-a012-bc02e4b2c646 service nova] [instance: ef9d1d9c-63d7-48a8-8efe-85b5b7f1cf11] Received event network-vif-deleted-c051e8bd-3bf8-4286-9394-7235ff5b47ac {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-3a3a0c87-802b-4d9f-bb96-1d2b65c2919e req-7beaa164-511b-42d9-a012-bc02e4b2c646 service nova] [instance: 4ef93dd8-db9b-49ae-97ea-7de91ab3ddd3] Received event network-vif-deleted-3917e5e4-7891-45d1-b015-20127d3fe142 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:20:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance spawned successfully.
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:32 user nova-compute[76391]: INFO nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 15 23:20:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:20:32 user nova-compute[76391]: INFO nova.compute.manager [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Took 8.67 seconds to build instance.
Nov 15 23:20:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-b0af-4a0a-b8f4-6651b3eb12f3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.784s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:20:38 user nova-compute[76391]: INFO nova.compute.claims [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Claim successful on node user
Nov 15 23:20:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.845s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:20:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:20:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Creating image(s)
Nov 15 23:20:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "/opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.199s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG nova.policy [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a0dc5a4052f4e9ebf3448d0ed5e5f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0d9ceea4a4748c4a4524ffb24a56e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.292s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk 1073741824" returned: 0 in 0.061s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.220s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Cannot resize image /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Ensure instance console log exists: /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Successfully created port: bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:20:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Successfully updated port: bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquired lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-changed-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Refreshing instance network info cache due to event network-changed-bfafef15-364d-43b4-956d-63cb6f9993dd. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] Acquiring lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Updating instance_info_cache with network_info: [{"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Releasing lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Instance network_info: |[{"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] Acquired lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.neutron [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Refreshing network info cache for port bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Start _get_guest_xml network_info=[{"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:20:43 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:43 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-105165344',display_name='tempest-AttachVolumeNegativeTest-server-105165344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-105165344',id=23,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/453g9RXHyV0RSU1J+KRpzOZMYn2I+W0okjGBmpUqdhls3WgHHv57uYTt9LSkD/8TxBaOgz7FU4ldig+5UAMcSvMQtym/XKTdsh8oVAiYhl09em170G040DsGLlu26ww==',key_name='tempest-keypair-1925932212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-blbhelr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=c28f3f3d-8148-4c30-8070-9acff631ab32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:70:3d,bridge_name='br-int',has_traffic_filtering=True,id=bfafef15-364d-43b4-956d-63cb6f9993dd,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfafef15-36') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'pci_devices' on Instance uuid c28f3f3d-8148-4c30-8070-9acff631ab32 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:20:43 user nova-compute[76391]:   <uuid>c28f3f3d-8148-4c30-8070-9acff631ab32</uuid>
Nov 15 23:20:43 user nova-compute[76391]:   <name>instance-00000017</name>
Nov 15 23:20:43 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:20:43 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:20:43 user nova-compute[76391]:   <metadata>
Nov 15 23:20:43 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:20:43 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:20:43 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-105165344</nova:name>
Nov 15 23:20:43 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:20:43</nova:creationTime>
Nov 15 23:20:43 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:20:43 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:20:43 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:20:43 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:20:43 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:20:43 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:20:43 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:20:43 user nova-compute[76391]:       <nova:owner>
Nov 15 23:20:43 user nova-compute[76391]:         <nova:user uuid="9a0dc5a4052f4e9ebf3448d0ed5e5f2a">tempest-AttachVolumeNegativeTest-511423013-project-member</nova:user>
Nov 15 23:20:43 user nova-compute[76391]:         <nova:project uuid="f0d9ceea4a4748c4a4524ffb24a56e97">tempest-AttachVolumeNegativeTest-511423013</nova:project>
Nov 15 23:20:43 user nova-compute[76391]:       </nova:owner>
Nov 15 23:20:43 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:20:43 user nova-compute[76391]:       <nova:ports>
Nov 15 23:20:43 user nova-compute[76391]:         <nova:port uuid="bfafef15-364d-43b4-956d-63cb6f9993dd">
Nov 15 23:20:43 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:20:43 user nova-compute[76391]:         </nova:port>
Nov 15 23:20:43 user nova-compute[76391]:       </nova:ports>
Nov 15 23:20:43 user nova-compute[76391]:     </nova:instance>
Nov 15 23:20:43 user nova-compute[76391]:   </metadata>
Nov 15 23:20:43 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:20:43 user nova-compute[76391]:     <system>
Nov 15 23:20:43 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:20:43 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:20:43 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:20:43 user nova-compute[76391]:       <entry name="serial">c28f3f3d-8148-4c30-8070-9acff631ab32</entry>
Nov 15 23:20:43 user nova-compute[76391]:       <entry name="uuid">c28f3f3d-8148-4c30-8070-9acff631ab32</entry>
Nov 15 23:20:43 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:20:43 user nova-compute[76391]:     </system>
Nov 15 23:20:43 user nova-compute[76391]:   </sysinfo>
Nov 15 23:20:43 user nova-compute[76391]:   <os>
Nov 15 23:20:43 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:20:43 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:20:43 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:20:43 user nova-compute[76391]:   </os>
Nov 15 23:20:43 user nova-compute[76391]:   <features>
Nov 15 23:20:43 user nova-compute[76391]:     <acpi/>
Nov 15 23:20:43 user nova-compute[76391]:     <apic/>
Nov 15 23:20:43 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:20:43 user nova-compute[76391]:   </features>
Nov 15 23:20:43 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:20:43 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:20:43 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:20:43 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:20:43 user nova-compute[76391]:   </clock>
Nov 15 23:20:43 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:20:43 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:20:43 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:20:43 user nova-compute[76391]:   </cpu>
Nov 15 23:20:43 user nova-compute[76391]:   <devices>
Nov 15 23:20:43 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:20:43 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:20:43 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk"/>
Nov 15 23:20:43 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:20:43 user nova-compute[76391]:     </disk>
Nov 15 23:20:43 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:20:43 user nova-compute[76391]:       <mac address="fa:16:3e:5e:70:3d"/>
Nov 15 23:20:43 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:43 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:20:43 user nova-compute[76391]:       <target dev="tapbfafef15-36"/>
Nov 15 23:20:43 user nova-compute[76391]:     </interface>
Nov 15 23:20:43 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:20:43 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/console.log" append="off"/>
Nov 15 23:20:43 user nova-compute[76391]:     </serial>
Nov 15 23:20:43 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:20:43 user nova-compute[76391]:     <video>
Nov 15 23:20:43 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:43 user nova-compute[76391]:     </video>
Nov 15 23:20:43 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:20:43 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:20:43 user nova-compute[76391]:     </rng>
Nov 15 23:20:43 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:20:43 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:20:43 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:20:43 user nova-compute[76391]:     </memballoon>
Nov 15 23:20:43 user nova-compute[76391]:   </devices>
Nov 15 23:20:43 user nova-compute[76391]: </domain>
Nov 15 23:20:43 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-105165344',display_name='tempest-AttachVolumeNegativeTest-server-105165344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-105165344',id=23,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/453g9RXHyV0RSU1J+KRpzOZMYn2I+W0okjGBmpUqdhls3WgHHv57uYTt9LSkD/8TxBaOgz7FU4ldig+5UAMcSvMQtym/XKTdsh8oVAiYhl09em170G040DsGLlu26ww==',key_name='tempest-keypair-1925932212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-blbhelr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=c28f3f3d-8148-4c30-8070-9acff631ab32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:70:3d,bridge_name='br-int',has_traffic_filtering=True,id=bfafef15-364d-43b4-956d-63cb6f9993dd,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfafef15-36') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG os_vif [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:70:3d,bridge_name='br-int',has_traffic_filtering=True,id=bfafef15-364d-43b4-956d-63cb6f9993dd,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfafef15-36') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01c93605-7339-5c22-b9d1-6c7e4b69e40f', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfafef15-36, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfafef15-36, col_values=(('qos', UUID('b48b57e1-9401-48f2-a1d5-205770a09e8d')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfafef15-36, col_values=(('external_ids', {'iface-id': 'bfafef15-364d-43b4-956d-63cb6f9993dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:70:3d', 'vm-uuid': 'c28f3f3d-8148-4c30-8070-9acff631ab32'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:44 user nova-compute[76391]: INFO os_vif [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:70:3d,bridge_name='br-int',has_traffic_filtering=True,id=bfafef15-364d-43b4-956d-63cb6f9993dd,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfafef15-36')
Nov 15 23:20:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:20:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No VIF found with MAC fa:16:3e:5e:70:3d, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:20:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Updated VIF entry in instance network info cache for port bfafef15-364d-43b4-956d-63cb6f9993dd. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:20:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Updating instance_info_cache with network_info: [{"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a2683d75-ba4e-4e8b-8a8d-e76ba53cbc7b req-b2788faa-9c19-48ac-8f34-84b8054542cf service nova] Releasing lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-27d5162e-50c2-47a3-8476-9c77fee186f9 req-fc24a2ed-2e0f-4ea9-acd0-0098cfcb1a88 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-27d5162e-50c2-47a3-8476-9c77fee186f9 req-fc24a2ed-2e0f-4ea9-acd0-0098cfcb1a88 service nova] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-27d5162e-50c2-47a3-8476-9c77fee186f9 req-fc24a2ed-2e0f-4ea9-acd0-0098cfcb1a88 service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-27d5162e-50c2-47a3-8476-9c77fee186f9 req-fc24a2ed-2e0f-4ea9-acd0-0098cfcb1a88 service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-27d5162e-50c2-47a3-8476-9c77fee186f9 req-fc24a2ed-2e0f-4ea9-acd0-0098cfcb1a88 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] No waiting events found dispatching network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:45 user nova-compute[76391]: WARNING nova.compute.manager [req-27d5162e-50c2-47a3-8476-9c77fee186f9 req-fc24a2ed-2e0f-4ea9-acd0-0098cfcb1a88 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received unexpected event network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd for instance with vm_state building and task_state spawning.
Nov 15 23:20:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:20:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Instance spawned successfully.
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:47 user nova-compute[76391]: INFO nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Took 8.95 seconds to spawn the instance on the hypervisor.
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:20:47 user nova-compute[76391]: INFO nova.compute.manager [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Took 10.17 seconds to build instance.
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-a219c087-1eea-463b-9ede-53f8ff36e1e6 req-2e24473d-1f7f-4361-a017-12e84806e49e service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a219c087-1eea-463b-9ede-53f8ff36e1e6 req-2e24473d-1f7f-4361-a017-12e84806e49e service nova] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a219c087-1eea-463b-9ede-53f8ff36e1e6 req-2e24473d-1f7f-4361-a017-12e84806e49e service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a219c087-1eea-463b-9ede-53f8ff36e1e6 req-2e24473d-1f7f-4361-a017-12e84806e49e service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-a219c087-1eea-463b-9ede-53f8ff36e1e6 req-2e24473d-1f7f-4361-a017-12e84806e49e service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] No waiting events found dispatching network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:47 user nova-compute[76391]: WARNING nova.compute.manager [req-a219c087-1eea-463b-9ede-53f8ff36e1e6 req-2e24473d-1f7f-4361-a017-12e84806e49e service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received unexpected event network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd for instance with vm_state active and task_state None.
Nov 15 23:20:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6d094e6c-a92b-4b4c-ac8e-3c95c9afa46d tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.293s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:20:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:20:50 user nova-compute[76391]: INFO nova.compute.claims [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Claim successful on node user
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:20:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.policy [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31c9241ef07041ddbe7266b4566d77a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4867a9ccd74893a5d0f6548dd0d26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:20:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Creating image(s)
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "/opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "/opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.205s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Successfully created port: 19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk 1073741824" returned: 0 in 0.052s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.203s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Cannot resize image /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Ensure instance console log exists: /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Successfully updated port: 19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "refresh_cache-f1b969e4-24ec-4b81-b9a9-54c29475d530" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquired lock "refresh_cache-f1b969e4-24ec-4b81-b9a9-54c29475d530" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-changed-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Refreshing instance network info cache due to event network-changed-19ac94a8-142a-4ab8-b18c-25c544352bd0. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] Acquiring lock "refresh_cache-f1b969e4-24ec-4b81-b9a9-54c29475d530" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Updating instance_info_cache with network_info: [{"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Releasing lock "refresh_cache-f1b969e4-24ec-4b81-b9a9-54c29475d530" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Instance network_info: |[{"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] Acquired lock "refresh_cache-f1b969e4-24ec-4b81-b9a9-54c29475d530" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Refreshing network info cache for port 19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Start _get_guest_xml network_info=[{"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:20:52 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:52 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-587303725',display_name='tempest-VolumesActionsTest-instance-587303725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-587303725',id=24,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed4867a9ccd74893a5d0f6548dd0d26d',ramdisk_id='',reservation_id='r-g2a8jii9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-751216714',owner_user_name='tempest-VolumesActionsTest-751216714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:51Z,user_data=None,user_id='31c9241ef07041ddbe7266b4566d77a2',uuid=f1b969e4-24ec-4b81-b9a9-54c29475d530,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Converting VIF {"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=19ac94a8-142a-4ab8-b18c-25c544352bd0,network=Network(4bb92ada-e377-4644-856d-5113792b56f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ac94a8-14') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lazy-loading 'pci_devices' on Instance uuid f1b969e4-24ec-4b81-b9a9-54c29475d530 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:20:52 user nova-compute[76391]:   <uuid>f1b969e4-24ec-4b81-b9a9-54c29475d530</uuid>
Nov 15 23:20:52 user nova-compute[76391]:   <name>instance-00000018</name>
Nov 15 23:20:52 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:20:52 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:20:52 user nova-compute[76391]:   <metadata>
Nov 15 23:20:52 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:20:52 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:20:52 user nova-compute[76391]:       <nova:name>tempest-VolumesActionsTest-instance-587303725</nova:name>
Nov 15 23:20:52 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:20:52</nova:creationTime>
Nov 15 23:20:52 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:20:52 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:20:52 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:20:52 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:20:52 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:20:52 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:20:52 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:20:52 user nova-compute[76391]:       <nova:owner>
Nov 15 23:20:52 user nova-compute[76391]:         <nova:user uuid="31c9241ef07041ddbe7266b4566d77a2">tempest-VolumesActionsTest-751216714-project-member</nova:user>
Nov 15 23:20:52 user nova-compute[76391]:         <nova:project uuid="ed4867a9ccd74893a5d0f6548dd0d26d">tempest-VolumesActionsTest-751216714</nova:project>
Nov 15 23:20:52 user nova-compute[76391]:       </nova:owner>
Nov 15 23:20:52 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:20:52 user nova-compute[76391]:       <nova:ports>
Nov 15 23:20:52 user nova-compute[76391]:         <nova:port uuid="19ac94a8-142a-4ab8-b18c-25c544352bd0">
Nov 15 23:20:52 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:20:52 user nova-compute[76391]:         </nova:port>
Nov 15 23:20:52 user nova-compute[76391]:       </nova:ports>
Nov 15 23:20:52 user nova-compute[76391]:     </nova:instance>
Nov 15 23:20:52 user nova-compute[76391]:   </metadata>
Nov 15 23:20:52 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:20:52 user nova-compute[76391]:     <system>
Nov 15 23:20:52 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:20:52 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:20:52 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:20:52 user nova-compute[76391]:       <entry name="serial">f1b969e4-24ec-4b81-b9a9-54c29475d530</entry>
Nov 15 23:20:52 user nova-compute[76391]:       <entry name="uuid">f1b969e4-24ec-4b81-b9a9-54c29475d530</entry>
Nov 15 23:20:52 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:20:52 user nova-compute[76391]:     </system>
Nov 15 23:20:52 user nova-compute[76391]:   </sysinfo>
Nov 15 23:20:52 user nova-compute[76391]:   <os>
Nov 15 23:20:52 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:20:52 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:20:52 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:20:52 user nova-compute[76391]:   </os>
Nov 15 23:20:52 user nova-compute[76391]:   <features>
Nov 15 23:20:52 user nova-compute[76391]:     <acpi/>
Nov 15 23:20:52 user nova-compute[76391]:     <apic/>
Nov 15 23:20:52 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:20:52 user nova-compute[76391]:   </features>
Nov 15 23:20:52 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:20:52 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:20:52 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:20:52 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:20:52 user nova-compute[76391]:   </clock>
Nov 15 23:20:52 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:20:52 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:20:52 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:20:52 user nova-compute[76391]:   </cpu>
Nov 15 23:20:52 user nova-compute[76391]:   <devices>
Nov 15 23:20:52 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:20:52 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:20:52 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk"/>
Nov 15 23:20:52 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:20:52 user nova-compute[76391]:     </disk>
Nov 15 23:20:52 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:20:52 user nova-compute[76391]:       <mac address="fa:16:3e:6c:bd:de"/>
Nov 15 23:20:52 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:52 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:20:52 user nova-compute[76391]:       <target dev="tap19ac94a8-14"/>
Nov 15 23:20:52 user nova-compute[76391]:     </interface>
Nov 15 23:20:52 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:20:52 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/console.log" append="off"/>
Nov 15 23:20:52 user nova-compute[76391]:     </serial>
Nov 15 23:20:52 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:20:52 user nova-compute[76391]:     <video>
Nov 15 23:20:52 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:20:52 user nova-compute[76391]:     </video>
Nov 15 23:20:52 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:20:52 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:20:52 user nova-compute[76391]:     </rng>
Nov 15 23:20:52 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:20:52 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:20:52 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:20:52 user nova-compute[76391]:     </memballoon>
Nov 15 23:20:52 user nova-compute[76391]:   </devices>
Nov 15 23:20:52 user nova-compute[76391]: </domain>
Nov 15 23:20:52 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-587303725',display_name='tempest-VolumesActionsTest-instance-587303725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-587303725',id=24,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed4867a9ccd74893a5d0f6548dd0d26d',ramdisk_id='',reservation_id='r-g2a8jii9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-751216714',owner_user_name='tempest-VolumesActionsTest-751216714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:20:51Z,user_data=None,user_id='31c9241ef07041ddbe7266b4566d77a2',uuid=f1b969e4-24ec-4b81-b9a9-54c29475d530,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:20:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Converting VIF {"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=19ac94a8-142a-4ab8-b18c-25c544352bd0,network=Network(4bb92ada-e377-4644-856d-5113792b56f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ac94a8-14') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG os_vif [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=19ac94a8-142a-4ab8-b18c-25c544352bd0,network=Network(4bb92ada-e377-4644-856d-5113792b56f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ac94a8-14') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2edb6fe5-57c5-52fc-aad1-a73468506396', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19ac94a8-14, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19ac94a8-14, col_values=(('qos', UUID('c5a5b491-e3b9-40b0-9ebe-896eda25cfea')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19ac94a8-14, col_values=(('external_ids', {'iface-id': '19ac94a8-142a-4ab8-b18c-25c544352bd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:bd:de', 'vm-uuid': 'f1b969e4-24ec-4b81-b9a9-54c29475d530'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:53 user nova-compute[76391]: INFO os_vif [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=19ac94a8-142a-4ab8-b18c-25c544352bd0,network=Network(4bb92ada-e377-4644-856d-5113792b56f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ac94a8-14')
Nov 15 23:20:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] No VIF found with MAC fa:16:3e:6c:bd:de, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Updated VIF entry in instance network info cache for port 19ac94a8-142a-4ab8-b18c-25c544352bd0. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Updating instance_info_cache with network_info: [{"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:20:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a260587b-2c55-4205-bd0c-ea1a818eb084 req-844e3ac9-3c21-4e37-81e3-704f4b6be827 service nova] Releasing lock "refresh_cache-f1b969e4-24ec-4b81-b9a9-54c29475d530" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:20:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-445ac1a3-8b70-43eb-a64e-cc10395f989c req-12752569-d3fc-490f-a306-94283a2951e7 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445ac1a3-8b70-43eb-a64e-cc10395f989c req-12752569-d3fc-490f-a306-94283a2951e7 service nova] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445ac1a3-8b70-43eb-a64e-cc10395f989c req-12752569-d3fc-490f-a306-94283a2951e7 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445ac1a3-8b70-43eb-a64e-cc10395f989c req-12752569-d3fc-490f-a306-94283a2951e7 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-445ac1a3-8b70-43eb-a64e-cc10395f989c req-12752569-d3fc-490f-a306-94283a2951e7 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] No waiting events found dispatching network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:55 user nova-compute[76391]: WARNING nova.compute.manager [req-445ac1a3-8b70-43eb-a64e-cc10395f989c req-12752569-d3fc-490f-a306-94283a2951e7 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received unexpected event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 for instance with vm_state building and task_state spawning.
Nov 15 23:20:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-70828cfe-1af6-47d8-b4e4-09b853f8a0f3 req-db741122-0019-435f-834c-7f9a6195ff16 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-70828cfe-1af6-47d8-b4e4-09b853f8a0f3 req-db741122-0019-435f-834c-7f9a6195ff16 service nova] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-70828cfe-1af6-47d8-b4e4-09b853f8a0f3 req-db741122-0019-435f-834c-7f9a6195ff16 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-70828cfe-1af6-47d8-b4e4-09b853f8a0f3 req-db741122-0019-435f-834c-7f9a6195ff16 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-70828cfe-1af6-47d8-b4e4-09b853f8a0f3 req-db741122-0019-435f-834c-7f9a6195ff16 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] No waiting events found dispatching network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:20:57 user nova-compute[76391]: WARNING nova.compute.manager [req-70828cfe-1af6-47d8-b4e4-09b853f8a0f3 req-db741122-0019-435f-834c-7f9a6195ff16 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received unexpected event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 for instance with vm_state building and task_state spawning.
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:20:57 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Instance spawned successfully.
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:20:57 user nova-compute[76391]: INFO nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 15 23:20:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:20:57 user nova-compute[76391]: INFO nova.compute.manager [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Took 6.78 seconds to build instance.
Nov 15 23:20:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5a944025-63ee-4087-bd9d-6137e9bf8814 tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.974s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:20:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:00 user nova-compute[76391]: INFO nova.compute.manager [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Rescuing
Nov 15 23:21:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:21:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:21:00 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-changed-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Refreshing instance network info cache due to event network-changed-fb1754d0-2e26-4fb7-865d-01cea7cfed94. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] Acquiring lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] Acquired lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.network.neutron [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Refreshing network info cache for port fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-8257cb75-1c3a-4836-a626-8bae9f60b53e req-e037ebb4-a72b-413e-b9ae-a7bc465b7cf8 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8257cb75-1c3a-4836-a626-8bae9f60b53e req-e037ebb4-a72b-413e-b9ae-a7bc465b7cf8 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8257cb75-1c3a-4836-a626-8bae9f60b53e req-e037ebb4-a72b-413e-b9ae-a7bc465b7cf8 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8257cb75-1c3a-4836-a626-8bae9f60b53e req-e037ebb4-a72b-413e-b9ae-a7bc465b7cf8 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-8257cb75-1c3a-4836-a626-8bae9f60b53e req-e037ebb4-a72b-413e-b9ae-a7bc465b7cf8 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:01 user nova-compute[76391]: WARNING nova.compute.manager [req-8257cb75-1c3a-4836-a626-8bae9f60b53e req-e037ebb4-a72b-413e-b9ae-a7bc465b7cf8 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.network.neutron [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updated VIF entry in instance network info cache for port fb1754d0-2e26-4fb7-865d-01cea7cfed94. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:21:01 user nova-compute[76391]: DEBUG nova.network.neutron [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updating instance_info_cache with network_info: [{"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-46ce20df-ff2c-48e7-bcdf-c999e933e372 req-3d946787-5187-4ee0-9857-14acaf53ec6d service nova] Releasing lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'flavor' on Instance uuid e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:02 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance destroyed successfully.
Nov 15 23:21:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:02 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Attempting a stable device rescue
Nov 15 23:21:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:02 user nova-compute[76391]: INFO nova.compute.manager [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Attaching volume 952c4e5f-1fe6-473a-badf-44aff1c6ecc7 to /dev/vdb
Nov 15 23:21:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:21:02 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Creating image(s)
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "/opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.043s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "49d8401046d2d46950ee40cb15ae6c3522f2196f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "49d8401046d2d46950ee40cb15ae6c3522f2196f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG os_brick.utils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99939ee-5b74-4379-abe9-de928f667c9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd010db-eb88-4dbf-a133-8debb2d46e61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc61bf5-4936-4893-8d9f-e38678fe2813]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3567fb4a-8b46-429b-9e29-098e8da81325]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:21:03 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de523bf-32b5-4809-8c54-84cd45455dc4]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG os_brick.utils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== get_connector_properties: return (1246ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updating existing volume attachment record: 317afda0-34e6-40fd-8646-175dc93c011b {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:03 user nova-compute[76391]: WARNING nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:03 user nova-compute[76391]: WARNING nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:03 user nova-compute[76391]: WARNING nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:03 user nova-compute[76391]: WARNING nova.compute.manager [req-4e9a792a-0f70-4e06-8578-1d54ce9e2602 req-3e278f27-5b1d-4fc6-8b00-1c8bda9c2828 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.part --force-share --output=json" returned: 0 in 0.203s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.virt.images [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] 10803993-5676-4744-abbe-6415c5599226 was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:21:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.part /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.part /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.converted" returned: 0 in 0.244s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "49d8401046d2d46950ee40cb15ae6c3522f2196f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.895s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "49d8401046d2d46950ee40cb15ae6c3522f2196f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "49d8401046d2d46950ee40cb15ae6c3522f2196f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f,backing_fmt=raw /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f,backing_fmt=raw /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue" returned: 0 in 0.059s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "49d8401046d2d46950ee40cb15ae6c3522f2196f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'migration_context' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<4559c90b-6fb9-4190-8d40-0832c743c2c7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Start _get_guest_xml network_info=[{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "vif_mac": "fa:16:3e:2f:58:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '10803993-5676-4744-abbe-6415c5599226', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndmToLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4559c90b-6fb9-4190-8d40-0832c743c2c7', 'attached_at': '', 'detached_at': '', 'volume_id': '283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'serial': '283d147a-4ff2-4fea-a7fb-ee4113eaa7cd'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'c64dae39-2834-4854-9d24-f85241d10423', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'resources' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<4559c90b-6fb9-4190-8d40-0832c743c2c7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'numa_topology' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<4559c90b-6fb9-4190-8d40-0832c743c2c7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:04 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:04 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<4559c90b-6fb9-4190-8d40-0832c743c2c7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndmToLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:21:04 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:04 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:04 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[310b9de3-6a73-42f8-9972-087642132f34]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YndmToLu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 23:21:04 user nova-compute[76391]: node.name = iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:21:04 user nova-compute[76391]: node.tpgt = -1
Nov 15 23:21:04 user nova-compute[76391]: node.startup = automatic
Nov 15 23:21:04 user nova-compute[76391]: node.leading_login = No
Nov 15 23:21:04 user nova-compute[76391]: iface.iscsi_ifacename = default
Nov 15 23:21:04 user nova-compute[76391]: iface.net_ifacename = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.ipaddress = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.prefix_len = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.hwaddress = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.transport_name = tcp
Nov 15 23:21:04 user nova-compute[76391]: iface.initiatorname = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.state = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.vlan_id = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.vlan_priority = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.vlan_state = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.iface_num = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.mtu = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.port = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.bootproto = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.subnet_mask = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.gateway = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_alt_client_id = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_dns = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_learn_iqn = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_vendor_id_state = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_vendor_id = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.dhcp_slp_da = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.fragmentation = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.gratuitous_arp = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.incoming_forwarding = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.tos_state = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.tos = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.ttl = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.delayed_ack = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.tcp_nagle = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.tcp_wsf_state = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.tcp_wsf = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.tcp_timer_scale = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.tcp_timestamp = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.redirect = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.def_task_mgmt_timeout = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.header_digest = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.data_digest = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.immediate_data = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.initial_r2t = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.data_seq_inorder = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.data_pdu_inorder = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.erl = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.max_receive_data_len = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.first_burst_len = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.max_outstanding_r2t = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.max_burst_len = 0
Nov 15 23:21:04 user nova-compute[76391]: iface.chap_auth = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.bidi_chap = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.strict_login_compliance = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.discovery_auth = <empty>
Nov 15 23:21:04 user nova-compute[76391]: iface.discovery_logout = <empty>
Nov 15 23:21:04 user nova-compute[76391]: node.discovery_address = <empty>
Nov 15 23:21:04 user nova-compute[76391]: node.discovery_port = 0
Nov 15 23:21:04 user nova-compute[76391]: node.discovery_type = static
Nov 15 23:21:04 user nova-compute[76391]: node.session.initial_cmdsn = 0
Nov 15 23:21:04 user nova-compute[76391]: node.session.initial_login_retry_max = 8
Nov 15 23:21:04 user nova-compute[76391]: node.session.xmit_thread_priority = -20
Nov 15 23:21:04 user nova-compute[76391]: node.session.cmds_max = 128
Nov 15 23:21:04 user nova-compute[76391]: node.session.queue_depth = 32
Nov 15 23:21:04 user nova-compute[76391]: node.session.nr_sessions = 1
Nov 15 23:21:04 user nova-compute[76391]: node.session.auth.authmethod = CHAP
Nov 15 23:21:04 user nova-compute[76391]: node.session.auth.username = YndmToLu
Nov 15 23:21:04 user nova-compute[76391]: node.session.auth.password = ***
Nov 15 23:21:04 user nova-compute[76391]: node.session.auth.username_in = <empty>
Nov 15 23:21:04 user nova-compute[76391]: node.session.auth.password_in = <empty>
Nov 15 23:21:04 user nova-compute[76391]: node.session.auth.chap_algs = MD5
Nov 15 23:21:04 user nova-compute[76391]: node.session.timeo.replacement_timeout = 120
Nov 15 23:21:04 user nova-compute[76391]: node.session.err_timeo.abort_timeout = 15
Nov 15 23:21:04 user nova-compute[76391]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 23:21:04 user nova-compute[76391]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 23:21:04 user nova-compute[76391]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.FastAbort = Yes
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.InitialR2T = No
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.ImmediateData = Yes
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.MaxConnections = 1
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 23:21:04 user nova-compute[76391]: node.session.iscsi.ERL = 0
Nov 15 23:21:04 user nova-compute[76391]: node.session.scan = manual
Nov 15 23:21:04 user nova-compute[76391]: node.session.reopen_max = 0
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].address = 172.16.0.220
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].port = 3260
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].startup = manual
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].tcp.window_size = 524288
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].tcp.type_of_service = 0
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].timeo.logout_timeout = 15
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].timeo.login_timeout = 15
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].timeo.auth_timeout = 45
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].iscsi.DataDigest = None
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].iscsi.IFMarker = No
Nov 15 23:21:04 user nova-compute[76391]: node.conn[0].iscsi.OFMarker = No
Nov 15 23:21:04 user nova-compute[76391]: # END RECORD
Nov 15 23:21:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14e06f0-c6b9-4dbe-8fd1-641e9fa93165]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1a931e-651b-4d08-967f-f26daef742e1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YndmToLu {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YndmToLu" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[244690e2-7955-40f9-9e47-b46763548c81]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YndmToLu'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61d3b9d-54d0-42d1-a262-c65ae7dfacce]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a970819-9ae6-466e-ba2f-f4fe7c9a988b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:04 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.137s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] HCTL ('33', '0', '0', 0) found on session 19 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eabe74-da3d-41af-a454-e0de3ed75c2d]: (4, ('0 0 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching for a device in session 19 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndmToLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23033633431616633', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:21:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633431616633', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173822820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173822820',id=15,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-xcuqv6hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:27Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=4559c90b-6fb9-4190-8d40-0832c743c2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "vif_mac": "fa:16:3e:2f:58:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "vif_mac": "fa:16:3e:2f:58:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'pci_devices' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.objects.base [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<4559c90b-6fb9-4190-8d40-0832c743c2c7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:21:05 user nova-compute[76391]:   <uuid>4559c90b-6fb9-4190-8d40-0832c743c2c7</uuid>
Nov 15 23:21:05 user nova-compute[76391]:   <name>instance-0000000f</name>
Nov 15 23:21:05 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:21:05 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:21:05 user nova-compute[76391]:   <metadata>
Nov 15 23:21:05 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:21:05 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:21:05 user nova-compute[76391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-173822820</nova:name>
Nov 15 23:21:05 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:21:04</nova:creationTime>
Nov 15 23:21:05 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:21:05 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:21:05 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:21:05 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:21:05 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:21:05 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:21:05 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:21:05 user nova-compute[76391]:       <nova:owner>
Nov 15 23:21:05 user nova-compute[76391]:         <nova:user uuid="323a9405e8854778bf826678f8ae876f">tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member</nova:user>
Nov 15 23:21:05 user nova-compute[76391]:         <nova:project uuid="9c28a381270e4f489acbbc7702c64c61">tempest-ServerBootFromVolumeStableRescueTest-194934661</nova:project>
Nov 15 23:21:05 user nova-compute[76391]:       </nova:owner>
Nov 15 23:21:05 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:21:05 user nova-compute[76391]:       <nova:ports>
Nov 15 23:21:05 user nova-compute[76391]:         <nova:port uuid="6553aad5-cc35-490e-95dc-96d4b144728c">
Nov 15 23:21:05 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 23:21:05 user nova-compute[76391]:         </nova:port>
Nov 15 23:21:05 user nova-compute[76391]:       </nova:ports>
Nov 15 23:21:05 user nova-compute[76391]:     </nova:instance>
Nov 15 23:21:05 user nova-compute[76391]:   </metadata>
Nov 15 23:21:05 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:21:05 user nova-compute[76391]:     <system>
Nov 15 23:21:05 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:21:05 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:21:05 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:21:05 user nova-compute[76391]:       <entry name="serial">4559c90b-6fb9-4190-8d40-0832c743c2c7</entry>
Nov 15 23:21:05 user nova-compute[76391]:       <entry name="uuid">4559c90b-6fb9-4190-8d40-0832c743c2c7</entry>
Nov 15 23:21:05 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:21:05 user nova-compute[76391]:     </system>
Nov 15 23:21:05 user nova-compute[76391]:   </sysinfo>
Nov 15 23:21:05 user nova-compute[76391]:   <os>
Nov 15 23:21:05 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:21:05 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:21:05 user nova-compute[76391]:   </os>
Nov 15 23:21:05 user nova-compute[76391]:   <features>
Nov 15 23:21:05 user nova-compute[76391]:     <acpi/>
Nov 15 23:21:05 user nova-compute[76391]:     <apic/>
Nov 15 23:21:05 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:21:05 user nova-compute[76391]:   </features>
Nov 15 23:21:05 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:21:05 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:21:05 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:21:05 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:21:05 user nova-compute[76391]:   </clock>
Nov 15 23:21:05 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:21:05 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:21:05 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:21:05 user nova-compute[76391]:   </cpu>
Nov 15 23:21:05 user nova-compute[76391]:   <devices>
Nov 15 23:21:05 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:21:05 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:21:05 user nova-compute[76391]:       <source dev="/dev/sdb"/>
Nov 15 23:21:05 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:21:05 user nova-compute[76391]:       <serial>283d147a-4ff2-4fea-a7fb-ee4113eaa7cd</serial>
Nov 15 23:21:05 user nova-compute[76391]:     </disk>
Nov 15 23:21:05 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:21:05 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:21:05 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue"/>
Nov 15 23:21:05 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:21:05 user nova-compute[76391]:       <boot order="1"/>
Nov 15 23:21:05 user nova-compute[76391]:     </disk>
Nov 15 23:21:05 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:21:05 user nova-compute[76391]:       <mac address="fa:16:3e:2f:58:72"/>
Nov 15 23:21:05 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:05 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:21:05 user nova-compute[76391]:       <target dev="tap6553aad5-cc"/>
Nov 15 23:21:05 user nova-compute[76391]:     </interface>
Nov 15 23:21:05 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:21:05 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/console.log" append="off"/>
Nov 15 23:21:05 user nova-compute[76391]:     </serial>
Nov 15 23:21:05 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:21:05 user nova-compute[76391]:     <video>
Nov 15 23:21:05 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:05 user nova-compute[76391]:     </video>
Nov 15 23:21:05 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:21:05 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:21:05 user nova-compute[76391]:     </rng>
Nov 15 23:21:05 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:21:05 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:21:05 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:21:05 user nova-compute[76391]:     </memballoon>
Nov 15 23:21:05 user nova-compute[76391]:   </devices>
Nov 15 23:21:05 user nova-compute[76391]: </domain>
Nov 15 23:21:05 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:21:05 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance destroyed successfully.
Nov 15 23:21:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No VIF found with MAC fa:16:3e:2f:58:72, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-f93d18bb-a3bd-4604-8e8e-78dca0cd4191 req-d18e482f-5443-4ee6-8a19-8ae42d6c9554 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f93d18bb-a3bd-4604-8e8e-78dca0cd4191 req-d18e482f-5443-4ee6-8a19-8ae42d6c9554 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f93d18bb-a3bd-4604-8e8e-78dca0cd4191 req-d18e482f-5443-4ee6-8a19-8ae42d6c9554 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f93d18bb-a3bd-4604-8e8e-78dca0cd4191 req-d18e482f-5443-4ee6-8a19-8ae42d6c9554 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-f93d18bb-a3bd-4604-8e8e-78dca0cd4191 req-d18e482f-5443-4ee6-8a19-8ae42d6c9554 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:05 user nova-compute[76391]: WARNING nova.compute.manager [req-f93d18bb-a3bd-4604-8e8e-78dca0cd4191 req-d18e482f-5443-4ee6-8a19-8ae42d6c9554 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:08 user nova-compute[76391]: WARNING nova.compute.manager [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:08 user nova-compute[76391]: WARNING nova.compute.manager [req-4590c5a0-4fc5-4fbb-b1ec-6b4942bbab14 req-7588d5e3-f927-46b6-9f06-4a002c020b53 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state rescuing.
Nov 15 23:21:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:21:08 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:08 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:08 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6369be-8c88-4f2b-88c3-e5f2a4c781b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:21:08 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f080fe5-ba56-4a21-ac4d-7f901440619e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7] added
Nov 15 23:21:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[102a6dc7-7f9f-4f99-97da-05705bb7ab17]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d8a05816-d817-4d72-974b-c4b5ecb9d71a tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa2efe-4143-43b6-9e77-3efed5eabce2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbUlykrD {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbUlykrD" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a12b1b-c9c4-4424-9291-fa19b2fa87c6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fbUlykrD'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1672b-25ec-4d59-ad1b-150847d39654]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe58fc-ac1f-4201-bee1-1d89f7817c4d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:21:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5dde0-e979-4d21-9816-5a756384144e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]
Nov 15 23:21:09 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.
Nov 15 23:21:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7012c08-0cb2-43cb-a6ea-60a8a5a26b34]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde0496-1d7b-4e01-9ea0-74d4caf4ec35]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:09 user nova-compute[76391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:21:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:09 user nova-compute[76391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:21:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d0f88d-9cdb-4af4-b687-c7099af2fe77]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:21:09 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26463336565376261', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463336565376261', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'flavor' on Instance uuid e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:21:10 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:21:10 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:21:10 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:21:10 user nova-compute[76391]:   <serial>952c4e5f-1fe6-473a-badf-44aff1c6ecc7</serial>
Nov 15 23:21:10 user nova-compute[76391]: </disk>
Nov 15 23:21:10 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No VIF found with MAC fa:16:3e:aa:01:54, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:21:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e2cb2522-85da-442d-ad63-561d0fa6c613 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.309s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:11 user nova-compute[76391]: INFO nova.compute.manager [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Rebuilding instance
Nov 15 23:21:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-d5f631a9-640d-4e66-9dfd-7562c33b92d2 req-55984218-60e1-416f-8e52-b34c8d43c5f3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d5f631a9-640d-4e66-9dfd-7562c33b92d2 req-55984218-60e1-416f-8e52-b34c8d43c5f3 service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d5f631a9-640d-4e66-9dfd-7562c33b92d2 req-55984218-60e1-416f-8e52-b34c8d43c5f3 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d5f631a9-640d-4e66-9dfd-7562c33b92d2 req-55984218-60e1-416f-8e52-b34c8d43c5f3 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-d5f631a9-640d-4e66-9dfd-7562c33b92d2 req-55984218-60e1-416f-8e52-b34c8d43c5f3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:12 user nova-compute[76391]: WARNING nova.compute.manager [req-d5f631a9-640d-4e66-9dfd-7562c33b92d2 req-55984218-60e1-416f-8e52-b34c8d43c5f3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuilding.
Nov 15 23:21:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:12 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance destroyed successfully.
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: INFO nova.compute.manager [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Rescuing
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: INFO nova.compute.manager [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Detaching volume 952c4e5f-1fe6-473a-badf-44aff1c6ecc7
Nov 15 23:21:13 user nova-compute[76391]: INFO nova.virt.block_device [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Attempting to driver detach volume 952c4e5f-1fe6-473a-badf-44aff1c6ecc7 from mountpoint /dev/vdb
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Attempting to detach device vdb from instance e08c5f26-850b-4d4a-89ab-88f2066acc71 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:21:13 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:21:13 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:21:13 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:21:13 user nova-compute[76391]:   <serial>952c4e5f-1fe6-473a-badf-44aff1c6ecc7</serial>
Nov 15 23:21:13 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:21:13 user nova-compute[76391]: </disk>
Nov 15 23:21:13 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully detached device vdb from instance e08c5f26-850b-4d4a-89ab-88f2066acc71 from the persistent domain config.
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:21:13 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c85904-57ed-4285-81aa-677ecc3cd7ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:21:13 user nova-compute[76391]: No targets found.
Nov 15 23:21:13 user nova-compute[76391]: iSNS:
Nov 15 23:21:13 user nova-compute[76391]: No targets found.
Nov 15 23:21:13 user nova-compute[76391]: STATIC:
Nov 15 23:21:13 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7
Nov 15 23:21:13 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:21:13 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:21:13 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:21:13 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:21:13 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:21:13 user nova-compute[76391]: FIRMWARE:
Nov 15 23:21:13 user nova-compute[76391]: No targets found.
Nov 15 23:21:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:21:13 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:21:13 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f999e-e942-48ef-9d15-b9682f8877ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d787b7b-13ab-4f28-9859-3bf02a28b759]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:13 user nova-compute[76391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:21:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:13 user nova-compute[76391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:21:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9764956050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88e272-47f2-41cb-968d-1e5ec9b80af9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[610b9622-6d75-4f68-8140-1e893e315b27]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updating instance_info_cache with network_info: [{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee3ffb-426b-4eb7-99dc-b0314a1cb66b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c95246-e153-40a3-8f27-e611dc3d0515]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86addf77-aac4-44fc-a347-3d3db66d04ec]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6365ff56-8299-497f-9ea9-915f5ae73da3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]
Nov 15 23:21:13 user nova-compute[76391]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.
Nov 15 23:21:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d61cb-6942-454c-9a23-0b030a3ce146]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== disconnect_volume: return (419ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuilding.
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuilding.
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuilding.
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuilding.
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuilding.
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-unplugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-unplugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-unplugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state active and task_state rescuing.
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.compute.manager [req-201e523d-8ad3-43b4-97bb-22a7de3ec806 req-3bfa980b-ef57-40a8-8319-714efac4049e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state active and task_state rescuing.
Nov 15 23:21:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance destroyed successfully.
Nov 15 23:21:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Attempting rescue
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:21:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Creating image(s)
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.203s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue" returned: 0 in 0.052s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'migration_context' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.base [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<d1c8427a-7299-4332-82eb-afc545cb6f8d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Start _get_guest_xml network_info=[{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:82:66:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'resources' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.base [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<d1c8427a-7299-4332-82eb-afc545cb6f8d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'numa_topology' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.base [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<d1c8427a-7299-4332-82eb-afc545cb6f8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:14 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.base [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<d1c8427a-7299-4332-82eb-afc545cb6f8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-893601650',display_name='tempest-ServerRescueNegativeTestJSON-server-893601650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-893601650',id=18,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:19:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-owkocc4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:34Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=d1c8427a-7299-4332-82eb-afc545cb6f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:82:66:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:82:66:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'pci_devices' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.objects.base [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<d1c8427a-7299-4332-82eb-afc545cb6f8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:21:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:21:14 user nova-compute[76391]:   <uuid>d1c8427a-7299-4332-82eb-afc545cb6f8d</uuid>
Nov 15 23:21:14 user nova-compute[76391]:   <name>instance-00000012</name>
Nov 15 23:21:14 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:21:14 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:21:14 user nova-compute[76391]:   <metadata>
Nov 15 23:21:14 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:21:14 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:21:14 user nova-compute[76391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-893601650</nova:name>
Nov 15 23:21:14 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:21:14</nova:creationTime>
Nov 15 23:21:14 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:21:14 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:21:14 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:21:14 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:21:14 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:21:14 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:21:14 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:21:14 user nova-compute[76391]:       <nova:owner>
Nov 15 23:21:14 user nova-compute[76391]:         <nova:user uuid="3986dd9981e24a0f8faf441662255bab">tempest-ServerRescueNegativeTestJSON-1623431733-project-member</nova:user>
Nov 15 23:21:14 user nova-compute[76391]:         <nova:project uuid="3d522b2994d4474999b1a2d2d474c74b">tempest-ServerRescueNegativeTestJSON-1623431733</nova:project>
Nov 15 23:21:14 user nova-compute[76391]:       </nova:owner>
Nov 15 23:21:14 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:21:14 user nova-compute[76391]:       <nova:ports>
Nov 15 23:21:14 user nova-compute[76391]:         <nova:port uuid="20833cf0-a0ae-4ea9-ad8d-d9f002e6f092">
Nov 15 23:21:14 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:21:14 user nova-compute[76391]:         </nova:port>
Nov 15 23:21:14 user nova-compute[76391]:       </nova:ports>
Nov 15 23:21:14 user nova-compute[76391]:     </nova:instance>
Nov 15 23:21:14 user nova-compute[76391]:   </metadata>
Nov 15 23:21:14 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:21:14 user nova-compute[76391]:     <system>
Nov 15 23:21:14 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:21:14 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:21:14 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:21:14 user nova-compute[76391]:       <entry name="serial">d1c8427a-7299-4332-82eb-afc545cb6f8d</entry>
Nov 15 23:21:14 user nova-compute[76391]:       <entry name="uuid">d1c8427a-7299-4332-82eb-afc545cb6f8d</entry>
Nov 15 23:21:14 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:21:14 user nova-compute[76391]:     </system>
Nov 15 23:21:14 user nova-compute[76391]:   </sysinfo>
Nov 15 23:21:14 user nova-compute[76391]:   <os>
Nov 15 23:21:14 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:21:14 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:21:14 user nova-compute[76391]:   </os>
Nov 15 23:21:14 user nova-compute[76391]:   <features>
Nov 15 23:21:14 user nova-compute[76391]:     <acpi/>
Nov 15 23:21:14 user nova-compute[76391]:     <apic/>
Nov 15 23:21:14 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:21:14 user nova-compute[76391]:   </features>
Nov 15 23:21:14 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:21:14 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:21:14 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:21:14 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:21:14 user nova-compute[76391]:   </clock>
Nov 15 23:21:14 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:21:14 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:21:14 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:21:14 user nova-compute[76391]:   </cpu>
Nov 15 23:21:14 user nova-compute[76391]:   <devices>
Nov 15 23:21:14 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:21:14 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:21:14 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue"/>
Nov 15 23:21:14 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:21:14 user nova-compute[76391]:     </disk>
Nov 15 23:21:14 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:21:14 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:21:14 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk"/>
Nov 15 23:21:14 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:21:14 user nova-compute[76391]:     </disk>
Nov 15 23:21:14 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:21:14 user nova-compute[76391]:       <mac address="fa:16:3e:82:66:f3"/>
Nov 15 23:21:14 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:14 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:21:14 user nova-compute[76391]:       <target dev="tap20833cf0-a0"/>
Nov 15 23:21:14 user nova-compute[76391]:     </interface>
Nov 15 23:21:14 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:21:14 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/console.log" append="off"/>
Nov 15 23:21:14 user nova-compute[76391]:     </serial>
Nov 15 23:21:14 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:21:14 user nova-compute[76391]:     <video>
Nov 15 23:21:14 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:14 user nova-compute[76391]:     </video>
Nov 15 23:21:14 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:21:14 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:21:14 user nova-compute[76391]:     </rng>
Nov 15 23:21:14 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:21:14 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:21:14 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:21:14 user nova-compute[76391]:     </memballoon>
Nov 15 23:21:14 user nova-compute[76391]:   </devices>
Nov 15 23:21:14 user nova-compute[76391]: </domain>
Nov 15 23:21:14 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:21:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance destroyed successfully.
Nov 15 23:21:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance destroyed successfully.
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1570175814',display_name='tempest-ServerActionsTestOtherA-server-1445601298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1570175814',id=16,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi7OcGSXERdzVghj+kaK9/smTbH1RoMpBm3euZr2fWrfoX9QzxsGY0Lot5k/+iXI2d+Dp+Ayun6DHTjVEDJ4lQ1BwidajYYk54Ho+5dt/K7+2DAQQWb4Y0QBXbxxb2JGA==',key_name='tempest-keypair-1702677550',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:19:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-203e6djh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e08c5f26-850b-4d4a-89ab-88f2066acc71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_vif [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb1754d0-2e, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5942f899-0a9f-4676-bdf3-b0a5cfbf831e) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:15 user nova-compute[76391]: INFO os_vif [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e')
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:21:15 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No VIF found with MAC fa:16:3e:82:66:f3, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce2faf8-b193-468d-9a72-23f113d4fd0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:21:15 user nova-compute[76391]: No targets found.
Nov 15 23:21:15 user nova-compute[76391]: iSNS:
Nov 15 23:21:15 user nova-compute[76391]: No targets found.
Nov 15 23:21:15 user nova-compute[76391]: STATIC:
Nov 15 23:21:15 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:21:15 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:21:15 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:21:15 user nova-compute[76391]: FIRMWARE:
Nov 15 23:21:15 user nova-compute[76391]: No targets found.
Nov 15 23:21:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:21:15 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:21:15 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a54d85-676f-4a83-8b14-a89d24d5721c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ae35ac-d1d2-4565-a42a-cbcf7cd7183a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740352ef0>, {}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Disconnecting from: [] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== disconnect_volume: return (76ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:21:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Deleting instance files /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71_del
Nov 15 23:21:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Deletion of /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71_del complete
Nov 15 23:21:15 user nova-compute[76391]: INFO nova.virt.block_device [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Booting with volume 952c4e5f-1fe6-473a-badf-44aff1c6ecc7 at /dev/vdb
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.utils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd87e39-8436-4ce8-ae51-d347a7e2e7e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bdc007-804e-412e-9705-1d9633a7455c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1923e71-c5cc-4317-ac07-e2325af85eee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fef9e2-0ffc-4b10-9e98-d5abb12bd11c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:21:15 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:21:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a242cd-4156-4438-a9d4-a5458d3d8197]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG os_brick.utils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:21:15 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updating existing volume attachment record: 15f16588-5a75-4049-8b20-c4f5fdc78120 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-7f442692-f680-4675-9ba5-fdb2c91e9ef2 req-d6c6075b-b8d6-4a43-b22e-752daab3df9e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7f442692-f680-4675-9ba5-fdb2c91e9ef2 req-d6c6075b-b8d6-4a43-b22e-752daab3df9e service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7f442692-f680-4675-9ba5-fdb2c91e9ef2 req-d6c6075b-b8d6-4a43-b22e-752daab3df9e service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7f442692-f680-4675-9ba5-fdb2c91e9ef2 req-d6c6075b-b8d6-4a43-b22e-752daab3df9e service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-7f442692-f680-4675-9ba5-fdb2c91e9ef2 req-d6c6075b-b8d6-4a43-b22e-752daab3df9e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:16 user nova-compute[76391]: WARNING nova.compute.manager [req-7f442692-f680-4675-9ba5-fdb2c91e9ef2 req-d6c6075b-b8d6-4a43-b22e-752daab3df9e service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state active and task_state rescuing.
Nov 15 23:21:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:18 user nova-compute[76391]: WARNING nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] While synchronizing instance power states, found 13 instances in the database and 12 instances on the hypervisor.
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 6626d0d5-79ae-433b-aa6f-94e69353c7d3 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 39cdf492-9c79-47f4-9437-aab5284b4dd3 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid d16e63a2-95bb-4709-960b-9518f4eb82e5 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid c28f3f3d-8148-4c30-8070-9acff631ab32 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid f1b969e4-24ec-4b81-b9a9-54c29475d530 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: INFO nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: INFO nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] During sync_power_state the instance has a pending task (rescuing). Skip.
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: WARNING oslo_messaging._drivers.amqpdriver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.173s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.186s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.207s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-4773f362-70c8-418e-aaaa-16ce03fc78b1 req-70a94aae-6fbc-4dec-bf37-57a6de260c7a service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4773f362-70c8-418e-aaaa-16ce03fc78b1 req-70a94aae-6fbc-4dec-bf37-57a6de260c7a service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4773f362-70c8-418e-aaaa-16ce03fc78b1 req-70a94aae-6fbc-4dec-bf37-57a6de260c7a service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4773f362-70c8-418e-aaaa-16ce03fc78b1 req-70a94aae-6fbc-4dec-bf37-57a6de260c7a service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-4773f362-70c8-418e-aaaa-16ce03fc78b1 req-70a94aae-6fbc-4dec-bf37-57a6de260c7a service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:18 user nova-compute[76391]: WARNING nova.compute.manager [req-4773f362-70c8-418e-aaaa-16ce03fc78b1 req-70a94aae-6fbc-4dec-bf37-57a6de260c7a service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state active and task_state rescuing.
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6dc17cea-9d23-45f8-b772-53c164e78730 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:21:19 user nova-compute[76391]: INFO nova.compute.claims [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Claim successful on node user
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:19 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.058s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:21:20 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.policy [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d5fb40133174f4db6f71696591de2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc691a9d5674fbb898dd6736e91613f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:21:20 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Creating image(s)
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "/opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "/opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.205s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.261s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk 1073741824" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.456s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG nova.network.neutron [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Successfully created port: 977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.283s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Cannot resize image /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Ensure instance console log exists: /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Successfully updated port: 977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "refresh_cache-f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquired lock "refresh_cache-f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received event network-changed-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Refreshing instance network info cache due to event network-changed-977e6da8-a014-42ea-b0d4-9045d3fb6df9. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] Acquiring lock "refresh_cache-f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Updating instance_info_cache with network_info: [{"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Releasing lock "refresh_cache-f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Instance network_info: |[{"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] Acquired lock "refresh_cache-f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Refreshing network info cache for port 977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Start _get_guest_xml network_info=[{"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:21:23 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:23 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2131804714',display_name='tempest-ServersNegativeTestJSON-server-2131804714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2131804714',id=25,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bc691a9d5674fbb898dd6736e91613f',ramdisk_id='',reservation_id='r-yzurdg05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-686980340',owner_user_name='tempest-ServersNegativeTestJSON-686980340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:21:21Z,user_data=None,user_id='9d5fb40133174f4db6f71696591de2a8',uuid=f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converting VIF {"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d3:7a,bridge_name='br-int',has_traffic_filtering=True,id=977e6da8-a014-42ea-b0d4-9045d3fb6df9,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap977e6da8-a0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.objects.instance [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lazy-loading 'pci_devices' on Instance uuid f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:21:23 user nova-compute[76391]:   <uuid>f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6</uuid>
Nov 15 23:21:23 user nova-compute[76391]:   <name>instance-00000019</name>
Nov 15 23:21:23 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:21:23 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:21:23 user nova-compute[76391]:   <metadata>
Nov 15 23:21:23 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:21:23 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:21:23 user nova-compute[76391]:       <nova:name>tempest-ServersNegativeTestJSON-server-2131804714</nova:name>
Nov 15 23:21:23 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:21:23</nova:creationTime>
Nov 15 23:21:23 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:21:23 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:21:23 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:21:23 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:21:23 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:21:23 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:21:23 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:21:23 user nova-compute[76391]:       <nova:owner>
Nov 15 23:21:23 user nova-compute[76391]:         <nova:user uuid="9d5fb40133174f4db6f71696591de2a8">tempest-ServersNegativeTestJSON-686980340-project-member</nova:user>
Nov 15 23:21:23 user nova-compute[76391]:         <nova:project uuid="9bc691a9d5674fbb898dd6736e91613f">tempest-ServersNegativeTestJSON-686980340</nova:project>
Nov 15 23:21:23 user nova-compute[76391]:       </nova:owner>
Nov 15 23:21:23 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:21:23 user nova-compute[76391]:       <nova:ports>
Nov 15 23:21:23 user nova-compute[76391]:         <nova:port uuid="977e6da8-a014-42ea-b0d4-9045d3fb6df9">
Nov 15 23:21:23 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 23:21:23 user nova-compute[76391]:         </nova:port>
Nov 15 23:21:23 user nova-compute[76391]:       </nova:ports>
Nov 15 23:21:23 user nova-compute[76391]:     </nova:instance>
Nov 15 23:21:23 user nova-compute[76391]:   </metadata>
Nov 15 23:21:23 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:21:23 user nova-compute[76391]:     <system>
Nov 15 23:21:23 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:21:23 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:21:23 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:21:23 user nova-compute[76391]:       <entry name="serial">f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6</entry>
Nov 15 23:21:23 user nova-compute[76391]:       <entry name="uuid">f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6</entry>
Nov 15 23:21:23 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:21:23 user nova-compute[76391]:     </system>
Nov 15 23:21:23 user nova-compute[76391]:   </sysinfo>
Nov 15 23:21:23 user nova-compute[76391]:   <os>
Nov 15 23:21:23 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:21:23 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:21:23 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:21:23 user nova-compute[76391]:   </os>
Nov 15 23:21:23 user nova-compute[76391]:   <features>
Nov 15 23:21:23 user nova-compute[76391]:     <acpi/>
Nov 15 23:21:23 user nova-compute[76391]:     <apic/>
Nov 15 23:21:23 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:21:23 user nova-compute[76391]:   </features>
Nov 15 23:21:23 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:21:23 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:21:23 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:21:23 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:21:23 user nova-compute[76391]:   </clock>
Nov 15 23:21:23 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:21:23 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:21:23 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:21:23 user nova-compute[76391]:   </cpu>
Nov 15 23:21:23 user nova-compute[76391]:   <devices>
Nov 15 23:21:23 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:21:23 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:21:23 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk"/>
Nov 15 23:21:23 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:21:23 user nova-compute[76391]:     </disk>
Nov 15 23:21:23 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:21:23 user nova-compute[76391]:       <mac address="fa:16:3e:a2:d3:7a"/>
Nov 15 23:21:23 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:23 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:21:23 user nova-compute[76391]:       <target dev="tap977e6da8-a0"/>
Nov 15 23:21:23 user nova-compute[76391]:     </interface>
Nov 15 23:21:23 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:21:23 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/console.log" append="off"/>
Nov 15 23:21:23 user nova-compute[76391]:     </serial>
Nov 15 23:21:23 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:21:23 user nova-compute[76391]:     <video>
Nov 15 23:21:23 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:23 user nova-compute[76391]:     </video>
Nov 15 23:21:23 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:21:23 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:21:23 user nova-compute[76391]:     </rng>
Nov 15 23:21:23 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:21:23 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:21:23 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:21:23 user nova-compute[76391]:     </memballoon>
Nov 15 23:21:23 user nova-compute[76391]:   </devices>
Nov 15 23:21:23 user nova-compute[76391]: </domain>
Nov 15 23:21:23 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2131804714',display_name='tempest-ServersNegativeTestJSON-server-2131804714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2131804714',id=25,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bc691a9d5674fbb898dd6736e91613f',ramdisk_id='',reservation_id='r-yzurdg05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-686980340',owner_user_name='tempest-ServersNegativeTestJSON-686980340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:21:21Z,user_data=None,user_id='9d5fb40133174f4db6f71696591de2a8',uuid=f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converting VIF {"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d3:7a,bridge_name='br-int',has_traffic_filtering=True,id=977e6da8-a014-42ea-b0d4-9045d3fb6df9,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap977e6da8-a0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG os_vif [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d3:7a,bridge_name='br-int',has_traffic_filtering=True,id=977e6da8-a014-42ea-b0d4-9045d3fb6df9,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap977e6da8-a0') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '570fe52a-2c35-5fec-8083-e5a3ea7da8b8', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap977e6da8-a0, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap977e6da8-a0, col_values=(('qos', UUID('f771ceee-f4a5-4c10-97c2-b3ad4ff0ec5a')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap977e6da8-a0, col_values=(('external_ids', {'iface-id': '977e6da8-a014-42ea-b0d4-9045d3fb6df9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:d3:7a', 'vm-uuid': 'f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:23 user nova-compute[76391]: INFO os_vif [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d3:7a,bridge_name='br-int',has_traffic_filtering=True,id=977e6da8-a014-42ea-b0d4-9045d3fb6df9,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap977e6da8-a0')
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] No VIF found with MAC fa:16:3e:a2:d3:7a, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Updated VIF entry in instance network info cache for port 977e6da8-a014-42ea-b0d4-9045d3fb6df9. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:21:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Updating instance_info_cache with network_info: [{"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e25368a9-2f6c-42e7-a859-b5c1b9f65e58 req-bd4cdf45-e9e6-4613-8025-1122bf6c52de service nova] Releasing lock "refresh_cache-f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:21:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Creating image(s)
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.229s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:24 user nova-compute[76391]: INFO nova.compute.manager [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Terminating instance
Nov 15 23:21:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.222s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk 1073741824" returned: 0 in 0.050s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-5e93cd8f-db77-40b0-bcdb-a513020eab15 req-1b1df171-79c2-47e0-80b0-9ed5a314205b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-vif-unplugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5e93cd8f-db77-40b0-bcdb-a513020eab15 req-1b1df171-79c2-47e0-80b0-9ed5a314205b service nova] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5e93cd8f-db77-40b0-bcdb-a513020eab15 req-1b1df171-79c2-47e0-80b0-9ed5a314205b service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5e93cd8f-db77-40b0-bcdb-a513020eab15 req-1b1df171-79c2-47e0-80b0-9ed5a314205b service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-5e93cd8f-db77-40b0-bcdb-a513020eab15 req-1b1df171-79c2-47e0-80b0-9ed5a314205b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] No waiting events found dispatching network-vif-unplugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-5e93cd8f-db77-40b0-bcdb-a513020eab15 req-1b1df171-79c2-47e0-80b0-9ed5a314205b service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-vif-unplugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4caa48f-2afc-40b1-a096-e28bc63b1bde req-f9b70a86-9fcd-4d21-8ff7-846755ea33ff service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received event network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4caa48f-2afc-40b1-a096-e28bc63b1bde req-f9b70a86-9fcd-4d21-8ff7-846755ea33ff service nova] Acquiring lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4caa48f-2afc-40b1-a096-e28bc63b1bde req-f9b70a86-9fcd-4d21-8ff7-846755ea33ff service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4caa48f-2afc-40b1-a096-e28bc63b1bde req-f9b70a86-9fcd-4d21-8ff7-846755ea33ff service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4caa48f-2afc-40b1-a096-e28bc63b1bde req-f9b70a86-9fcd-4d21-8ff7-846755ea33ff service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] No waiting events found dispatching network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:26 user nova-compute[76391]: WARNING nova.compute.manager [req-b4caa48f-2afc-40b1-a096-e28bc63b1bde req-f9b70a86-9fcd-4d21-8ff7-846755ea33ff service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received unexpected event network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 for instance with vm_state building and task_state spawning.
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 1.446s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6952MB free_disk=25.20193862915039GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Instance destroyed successfully.
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.objects.instance [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lazy-loading 'resources' on Instance uuid 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1453386048',display_name='tempest-VolumesAdminNegativeTest-server-1453386048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1453386048',id=3,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcLk6QvYzeO2n+IYkbo87dBd+OrEJL1Azdpa19HYDGuaeYaQHn/TdyagNBJz97hlfv7g8ZYlCxKTQzu8Q1r1mTCVYs6gHj80C9s0P3mrQYq15rFC9RTyNap3zggJNHJyw==',key_name='tempest-keypair-1120412013',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:15:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36a5adda4e479884daa83ddb23d9da',ramdisk_id='',reservation_id='r-8t0iahhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2137202579',owner_user_name='tempest-VolumesAdminNegativeTest-2137202579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:15:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a69f501c85d14ba9a335d49127b2e534',uuid=5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converting VIF {"id": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "address": "fa:16:3e:dd:1d:59", "network": {"id": "ff1815b4-1d8c-4a8c-9a7c-091fc65ef636", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-19903480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36a5adda4e479884daa83ddb23d9da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5abf29b6-5d", "ovs_interfaceid": "5abf29b6-5d3c-44e5-963f-5152c4ef6b23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:1d:59,bridge_name='br-int',has_traffic_filtering=True,id=5abf29b6-5d3c-44e5-963f-5152c4ef6b23,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abf29b6-5d') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_vif [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:1d:59,bridge_name='br-int',has_traffic_filtering=True,id=5abf29b6-5d3c-44e5-963f-5152c4ef6b23,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abf29b6-5d') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5abf29b6-5d, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ec1d9d6-de72-437c-b002-2cbc75621052) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:26 user nova-compute[76391]: INFO os_vif [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:1d:59,bridge_name='br-int',has_traffic_filtering=True,id=5abf29b6-5d3c-44e5-963f-5152c4ef6b23,network=Network(ff1815b4-1d8c-4a8c-9a7c-091fc65ef636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5abf29b6-5d')
Nov 15 23:21:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Deleting instance files /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee_del
Nov 15 23:21:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Deletion of /opt/stack/data/nova/instances/5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee_del complete
Nov 15 23:21:26 user nova-compute[76391]: INFO nova.compute.manager [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Cannot resize image /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Ensure instance console log exists: /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Start _get_guest_xml network_info=[{"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e08c5f26-850b-4d4a-89ab-88f2066acc71', 'attached_at': '', 'detached_at': '', 'volume_id': '952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'serial': '952c4e5f-1fe6-473a-badf-44aff1c6ecc7'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '15f16588-5a75-4049-8b20-c4f5fdc78120', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:21:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 23:21:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e08c5f26-850b-4d4a-89ab-88f2066acc71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d16e63a2-95bb-4709-960b-9518f4eb82e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance c28f3f3d-8148-4c30-8070-9acff631ab32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance f1b969e4-24ec-4b81-b9a9-54c29475d530 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.objects.instance [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'vcpu_model' on Instance uuid e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:21:26 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:26 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:21:26 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a934a4e-bdf0-4922-8d93-d010eb837913]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:21:26 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a29c51-4452-4b1d-9ecc-fbd34f1dc48f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7] added
Nov 15 23:21:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3060db8-368f-4f36-a9f0-f536a3466d8c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fd6b78-f396-4459-8498-b4515d37fc71]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbUlykrD {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbUlykrD" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53377252-8114-45ed-8d96-df9a9cc6d631]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fbUlykrD'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[458af08b-63f6-4de5-b3a1-1319de8ff039]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[403039c6-eee8-4187-86fa-720af5e39844]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09d00db-2610-4ee7-bb64-0db7b41625f8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:26 user nova-compute[76391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09d00db-2610-4ee7-bb64-0db7b41625f8 (non-flash)
Nov 15 23:21:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:26 user nova-compute[76391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09d00db-2610-4ee7-bb64-0db7b41625f8 (non-flash)
Nov 15 23:21:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:21:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0164e47-9016-4a79-b71a-c8538d1e7e7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]
Nov 15 23:21:27 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.
Nov 15 23:21:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e4171-e681-4378-8c97-5c092bd53e9c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf416c60-22ba-4130-a0cf-897308bc861a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09d00db-2610-4ee7-bb64-0db7b41625f8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:27 user nova-compute[76391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09d00db-2610-4ee7-bb64-0db7b41625f8 (non-flash)
Nov 15 23:21:27 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:21:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:21:27 user nova-compute[76391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a09d00db-2610-4ee7-bb64-0db7b41625f8 (non-flash)
Nov 15 23:21:27 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:21:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76b119-d660-4c3b-8776-f999a507aa9a]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.995s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:21:27 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Took 0.88 seconds to deallocate network for instance.
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-5ff72cb3-391b-4376-b197-7254b144cb20 req-ffa8110d-d5ab-4a4b-a8a5-4535e85feb09 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5ff72cb3-391b-4376-b197-7254b144cb20 req-ffa8110d-d5ab-4a4b-a8a5-4535e85feb09 service nova] Acquiring lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5ff72cb3-391b-4376-b197-7254b144cb20 req-ffa8110d-d5ab-4a4b-a8a5-4535e85feb09 service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5ff72cb3-391b-4376-b197-7254b144cb20 req-ffa8110d-d5ab-4a4b-a8a5-4535e85feb09 service nova] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-5ff72cb3-391b-4376-b197-7254b144cb20 req-ffa8110d-d5ab-4a4b-a8a5-4535e85feb09 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] No waiting events found dispatching network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:27 user nova-compute[76391]: WARNING nova.compute.manager [req-5ff72cb3-391b-4376-b197-7254b144cb20 req-ffa8110d-d5ab-4a4b-a8a5-4535e85feb09 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received unexpected event network-vif-plugged-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 for instance with vm_state active and task_state deleting.
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e2a62bf-b40f-4e3c-9568-54be2db740a0 req-f570b6db-52fd-4eb5-b41e-9957b0803ca5 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received event network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e2a62bf-b40f-4e3c-9568-54be2db740a0 req-f570b6db-52fd-4eb5-b41e-9957b0803ca5 service nova] Acquiring lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e2a62bf-b40f-4e3c-9568-54be2db740a0 req-f570b6db-52fd-4eb5-b41e-9957b0803ca5 service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e2a62bf-b40f-4e3c-9568-54be2db740a0 req-f570b6db-52fd-4eb5-b41e-9957b0803ca5 service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e2a62bf-b40f-4e3c-9568-54be2db740a0 req-f570b6db-52fd-4eb5-b41e-9957b0803ca5 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] No waiting events found dispatching network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:27 user nova-compute[76391]: WARNING nova.compute.manager [req-0e2a62bf-b40f-4e3c-9568-54be2db740a0 req-f570b6db-52fd-4eb5-b41e-9957b0803ca5 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received unexpected event network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 for instance with vm_state building and task_state spawning.
Nov 15 23:21:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e2a62bf-b40f-4e3c-9568-54be2db740a0 req-f570b6db-52fd-4eb5-b41e-9957b0803ca5 service nova] [instance: 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee] Received event network-vif-deleted-5abf29b6-5d3c-44e5-963f-5152c4ef6b23 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:21:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Instance spawned successfully.
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26463336565376261', 'path': '/dev/sdd'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463336565376261', 'path': '/dev/sdd'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:21:28 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Deleted allocations for instance 5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1570175814',display_name='tempest-ServerActionsTestOtherA-server-1445601298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1570175814',id=16,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi7OcGSXERdzVghj+kaK9/smTbH1RoMpBm3euZr2fWrfoX9QzxsGY0Lot5k/+iXI2d+Dp+Ayun6DHTjVEDJ4lQ1BwidajYYk54Ho+5dt/K7+2DAQQWb4Y0QBXbxxb2JGA==',key_name='tempest-keypair-1702677550',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:19:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-203e6djh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e08c5f26-850b-4d4a-89ab-88f2066acc71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:21:28 user nova-compute[76391]:   <uuid>e08c5f26-850b-4d4a-89ab-88f2066acc71</uuid>
Nov 15 23:21:28 user nova-compute[76391]:   <name>instance-00000010</name>
Nov 15 23:21:28 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:21:28 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:21:28 user nova-compute[76391]:   <metadata>
Nov 15 23:21:28 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:21:28 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:21:28 user nova-compute[76391]:       <nova:name>tempest-ServerActionsTestOtherA-server-1445601298</nova:name>
Nov 15 23:21:28 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:21:26</nova:creationTime>
Nov 15 23:21:28 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:21:28 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:21:28 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:21:28 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:21:28 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:21:28 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:21:28 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:21:28 user nova-compute[76391]:       <nova:owner>
Nov 15 23:21:28 user nova-compute[76391]:         <nova:user uuid="c9170a4bb51b41d289416bb371c98a3b">tempest-ServerActionsTestOtherA-1370446029-project-member</nova:user>
Nov 15 23:21:28 user nova-compute[76391]:         <nova:project uuid="472379097b584f5da5aa8f5c919f2e82">tempest-ServerActionsTestOtherA-1370446029</nova:project>
Nov 15 23:21:28 user nova-compute[76391]:       </nova:owner>
Nov 15 23:21:28 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:21:28 user nova-compute[76391]:       <nova:ports>
Nov 15 23:21:28 user nova-compute[76391]:         <nova:port uuid="fb1754d0-2e26-4fb7-865d-01cea7cfed94">
Nov 15 23:21:28 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 23:21:28 user nova-compute[76391]:         </nova:port>
Nov 15 23:21:28 user nova-compute[76391]:       </nova:ports>
Nov 15 23:21:28 user nova-compute[76391]:     </nova:instance>
Nov 15 23:21:28 user nova-compute[76391]:   </metadata>
Nov 15 23:21:28 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:21:28 user nova-compute[76391]:     <system>
Nov 15 23:21:28 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:21:28 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:21:28 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:21:28 user nova-compute[76391]:       <entry name="serial">e08c5f26-850b-4d4a-89ab-88f2066acc71</entry>
Nov 15 23:21:28 user nova-compute[76391]:       <entry name="uuid">e08c5f26-850b-4d4a-89ab-88f2066acc71</entry>
Nov 15 23:21:28 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:21:28 user nova-compute[76391]:     </system>
Nov 15 23:21:28 user nova-compute[76391]:   </sysinfo>
Nov 15 23:21:28 user nova-compute[76391]:   <os>
Nov 15 23:21:28 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:21:28 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:21:28 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:21:28 user nova-compute[76391]:   </os>
Nov 15 23:21:28 user nova-compute[76391]:   <features>
Nov 15 23:21:28 user nova-compute[76391]:     <acpi/>
Nov 15 23:21:28 user nova-compute[76391]:     <apic/>
Nov 15 23:21:28 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:21:28 user nova-compute[76391]:   </features>
Nov 15 23:21:28 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:21:28 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:21:28 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:21:28 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:21:28 user nova-compute[76391]:   </clock>
Nov 15 23:21:28 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:21:28 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:21:28 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:21:28 user nova-compute[76391]:   </cpu>
Nov 15 23:21:28 user nova-compute[76391]:   <devices>
Nov 15 23:21:28 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:21:28 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:21:28 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk"/>
Nov 15 23:21:28 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:21:28 user nova-compute[76391]:     </disk>
Nov 15 23:21:28 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:21:28 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:21:28 user nova-compute[76391]:       <source dev="/dev/sdd"/>
Nov 15 23:21:28 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:21:28 user nova-compute[76391]:       <serial>952c4e5f-1fe6-473a-badf-44aff1c6ecc7</serial>
Nov 15 23:21:28 user nova-compute[76391]:     </disk>
Nov 15 23:21:28 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:21:28 user nova-compute[76391]:       <mac address="fa:16:3e:aa:01:54"/>
Nov 15 23:21:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:28 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:21:28 user nova-compute[76391]:       <target dev="tapfb1754d0-2e"/>
Nov 15 23:21:28 user nova-compute[76391]:     </interface>
Nov 15 23:21:28 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:21:28 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/console.log" append="off"/>
Nov 15 23:21:28 user nova-compute[76391]:     </serial>
Nov 15 23:21:28 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:21:28 user nova-compute[76391]:     <video>
Nov 15 23:21:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:21:28 user nova-compute[76391]:     </video>
Nov 15 23:21:28 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:21:28 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:21:28 user nova-compute[76391]:     </rng>
Nov 15 23:21:28 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:21:28 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:21:28 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:21:28 user nova-compute[76391]:     </memballoon>
Nov 15 23:21:28 user nova-compute[76391]:   </devices>
Nov 15 23:21:28 user nova-compute[76391]: </domain>
Nov 15 23:21:28 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1570175814',display_name='tempest-ServerActionsTestOtherA-server-1445601298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1570175814',id=16,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi7OcGSXERdzVghj+kaK9/smTbH1RoMpBm3euZr2fWrfoX9QzxsGY0Lot5k/+iXI2d+Dp+Ayun6DHTjVEDJ4lQ1BwidajYYk54Ho+5dt/K7+2DAQQWb4Y0QBXbxxb2JGA==',key_name='tempest-keypair-1702677550',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:19:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-203e6djh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e08c5f26-850b-4d4a-89ab-88f2066acc71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG os_vif [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:21:28 user nova-compute[76391]: INFO nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db0f43d0-f338-5a95-bd95-01706ffccb73', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb1754d0-2e, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb1754d0-2e, col_values=(('qos', UUID('2f3d1c89-b1cc-4216-aa63-0359c4b2b997')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb1754d0-2e, col_values=(('external_ids', {'iface-id': 'fb1754d0-2e26-4fb7-865d-01cea7cfed94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:01:54', 'vm-uuid': 'e08c5f26-850b-4d4a-89ab-88f2066acc71'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:28 user nova-compute[76391]: INFO os_vif [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e')
Nov 15 23:21:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb8dba9d-262b-4765-847c-aa3c310e8aba tempest-VolumesAdminNegativeTest-2137202579 tempest-VolumesAdminNegativeTest-2137202579-project-member] Lock "5b9a7397-627e-4ab3-a9e9-d3e50d3c46ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.415s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No VIF found with MAC fa:16:3e:aa:01:54, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:21:28 user nova-compute[76391]: INFO nova.compute.manager [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Took 9.18 seconds to build instance.
Nov 15 23:21:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-55c776b2-bcf7-43fd-9850-65256b0fdb9e tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.293s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:21:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:21:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-82e1dee9-e822-4d8c-a995-e9a015648b70 req-13dc7ab5-4c45-4087-8196-6f15f24cf6c9 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-82e1dee9-e822-4d8c-a995-e9a015648b70 req-13dc7ab5-4c45-4087-8196-6f15f24cf6c9 service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-82e1dee9-e822-4d8c-a995-e9a015648b70 req-13dc7ab5-4c45-4087-8196-6f15f24cf6c9 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-82e1dee9-e822-4d8c-a995-e9a015648b70 req-13dc7ab5-4c45-4087-8196-6f15f24cf6c9 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-82e1dee9-e822-4d8c-a995-e9a015648b70 req-13dc7ab5-4c45-4087-8196-6f15f24cf6c9 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:30 user nova-compute[76391]: WARNING nova.compute.manager [req-82e1dee9-e822-4d8c-a995-e9a015648b70 req-13dc7ab5-4c45-4087-8196-6f15f24cf6c9 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 23:21:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-b0a18fc1-09a1-4d2c-8e5b-18702ce12c69 req-4859d946-14b8-48a1-9eae-8f7995bd94e3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b0a18fc1-09a1-4d2c-8e5b-18702ce12c69 req-4859d946-14b8-48a1-9eae-8f7995bd94e3 service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b0a18fc1-09a1-4d2c-8e5b-18702ce12c69 req-4859d946-14b8-48a1-9eae-8f7995bd94e3 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b0a18fc1-09a1-4d2c-8e5b-18702ce12c69 req-4859d946-14b8-48a1-9eae-8f7995bd94e3 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-b0a18fc1-09a1-4d2c-8e5b-18702ce12c69 req-4859d946-14b8-48a1-9eae-8f7995bd94e3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:21:32 user nova-compute[76391]: WARNING nova.compute.manager [req-b0a18fc1-09a1-4d2c-8e5b-18702ce12c69 req-4859d946-14b8-48a1-9eae-8f7995bd94e3 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:21:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance spawned successfully.
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:21:32 user nova-compute[76391]: DEBUG nova.objects.instance [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 23:21:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1c804971-9fc3-4923-acdd-67714c013547 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.091s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:21:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:21:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:05 user nova-compute[76391]: DEBUG nova.objects.instance [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lazy-loading 'flavor' on Instance uuid d16e63a2-95bb-4709-960b-9518f4eb82e5 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:06 user nova-compute[76391]: INFO nova.compute.manager [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Attaching volume a3f08d43-f93d-4ddc-9a3f-05cb693e4aed to /dev/vdb
Nov 15 23:22:06 user nova-compute[76391]: DEBUG os_brick.utils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dd2e56-df8f-402d-915f-b01a21478c54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09e244-7bab-4948-9d88-fc71e171f634]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba4efc-2e92-4d39-91ab-4c751885a358]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[011743d1-f064-4758-a0f7-d22e5ae7ed77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:22:06 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:22:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9e6164-2ebc-4328-b837-a5a9a9ab8174]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG os_brick.utils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:22:06 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Updating existing volume attachment record: 4bbb6cd6-ac59-49d6-a389-e2e9ec88e1c2 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:22:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing instance network info cache due to event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] Acquiring lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] Acquired lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG nova.network.neutron [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing network info cache for port 15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQZMlnWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:22:11 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:22:11 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:22:11 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba4309-91cb-42f7-be06-63ff5b90b7b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:22:11 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c4412d-e3c6-4cad-a9f6-09906f223bc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed] added
Nov 15 23:22:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[398e1ec0-75cc-4f85-b015-283dc1686d80]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG nova.network.neutron [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updated VIF entry in instance network info cache for port 15463d4f-33b1-488b-85a6-ba2d5c15c10b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG nova.network.neutron [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f0515-d708-4062-98b3-c177c3455d86]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQZMlnWt {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3958267c-1c39-4468-a11b-b41181c16e8d req-c8322872-f609-4f79-b078-9bc2d2d4e279 service nova] Releasing lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQZMlnWt" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[254baedf-ce46-4c85-99aa-8892a0f626c1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQZMlnWt'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f171fd76-6771-4917-b2c1-7f8a8f254ee0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacaea36-42d6-4e45-9bad-4ef9b67cf8d3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:11 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:11 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acc520e-ca40-421d-a087-ef8683dfab26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260]
Nov 15 23:22:11 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260] successful.
Nov 15 23:22:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[429603cd-0577-4edb-aa9b-17abd43ad077]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e175ed12-c096-41d6-b3f5-1503b1ecea15]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:11 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:11 user nova-compute[76391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed (non-flash)
Nov 15 23:22:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:11 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:11 user nova-compute[76391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed (non-flash)
Nov 15 23:22:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4357178c-01e6-4cdd-868e-78817ee7d3e9]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:22:12 user nova-compute[76391]: INFO nova.compute.manager [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] instance snapshotting
Nov 15 23:22:12 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Beginning live snapshot process
Nov 15 23:22:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQZMlnWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23030346636633362', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030346636633362', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG nova.objects.instance [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lazy-loading 'flavor' on Instance uuid d16e63a2-95bb-4709-960b-9518f4eb82e5 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:22:12 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:22:12 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:22:12 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:22:12 user nova-compute[76391]:   <serial>a3f08d43-f93d-4ddc-9a3f-05cb693e4aed</serial>
Nov 15 23:22:12 user nova-compute[76391]: </disk>
Nov 15 23:22:12 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json -f qcow2" returned: 0 in 0.235s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.217s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc3fe8qvr/983746c3cc1b44019d65c644f02eb1a1.delta 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc3fe8qvr/983746c3cc1b44019d65c644f02eb1a1.delta 1073741824" returned: 0 in 0.058s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 23:22:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] No VIF found with MAC fa:16:3e:5c:58:83, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:22:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-497ed1b8-d45f-4bbf-a7f1-c0dab6e867ee tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.507s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:14 user nova-compute[76391]: INFO nova.compute.manager [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Terminating instance
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-8e38ff4b-11c2-43e0-a4ca-3eab35f57761 req-fc7425f1-1633-4956-8974-3762c0f9cabd service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received event network-vif-unplugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8e38ff4b-11c2-43e0-a4ca-3eab35f57761 req-fc7425f1-1633-4956-8974-3762c0f9cabd service nova] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8e38ff4b-11c2-43e0-a4ca-3eab35f57761 req-fc7425f1-1633-4956-8974-3762c0f9cabd service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8e38ff4b-11c2-43e0-a4ca-3eab35f57761 req-fc7425f1-1633-4956-8974-3762c0f9cabd service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-8e38ff4b-11c2-43e0-a4ca-3eab35f57761 req-fc7425f1-1633-4956-8974-3762c0f9cabd service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] No waiting events found dispatching network-vif-unplugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-8e38ff4b-11c2-43e0-a4ca-3eab35f57761 req-fc7425f1-1633-4956-8974-3762c0f9cabd service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received event network-vif-unplugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] COPY block job progress, current cursor: 14876672 final cursor: 75497472 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Instance destroyed successfully.
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lazy-loading 'resources' on Instance uuid d16e63a2-95bb-4709-960b-9518f4eb82e5 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-983976004',display_name='tempest-DeleteServersTestJSON-server-983976004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-983976004',id=20,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='935e1038cf1945748b7330846501a7f8',ramdisk_id='',reservation_id='r-3l0b2f7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2070975080',owner_user_name='tempest-DeleteServersTestJSON-2070975080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:20:21Z,user_data=None,user_id='d0c9e701d0284b2aa0e84377caa58bdd',uuid=d16e63a2-95bb-4709-960b-9518f4eb82e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Converting VIF {"id": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "address": "fa:16:3e:5c:58:83", "network": {"id": "2e874fe1-93bf-428f-a0cf-c1a5f25f9248", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-489999344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "935e1038cf1945748b7330846501a7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5454cae-68", "ovs_interfaceid": "d5454cae-68f5-4e35-ad54-9fc20f309d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:83,bridge_name='br-int',has_traffic_filtering=True,id=d5454cae-68f5-4e35-ad54-9fc20f309d1e,network=Network(2e874fe1-93bf-428f-a0cf-c1a5f25f9248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5454cae-68') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG os_vif [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:83,bridge_name='br-int',has_traffic_filtering=True,id=d5454cae-68f5-4e35-ad54-9fc20f309d1e,network=Network(2e874fe1-93bf-428f-a0cf-c1a5f25f9248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5454cae-68') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5454cae-68, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d40888f7-f125-4a96-840c-0c226d7b5a97) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:14 user nova-compute[76391]: INFO os_vif [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:83,bridge_name='br-int',has_traffic_filtering=True,id=d5454cae-68f5-4e35-ad54-9fc20f309d1e,network=Network(2e874fe1-93bf-428f-a0cf-c1a5f25f9248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5454cae-68')
Nov 15 23:22:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQZMlnWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:22:14 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:22:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca4cf4d-ad7b-4e8e-8844-cf05e1fa0ff1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:22:14 user nova-compute[76391]: No targets found.
Nov 15 23:22:14 user nova-compute[76391]: iSNS:
Nov 15 23:22:14 user nova-compute[76391]: No targets found.
Nov 15 23:22:14 user nova-compute[76391]: STATIC:
Nov 15 23:22:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed
Nov 15 23:22:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:22:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:22:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7
Nov 15 23:22:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:22:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:22:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:22:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:22:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:22:14 user nova-compute[76391]: FIRMWARE:
Nov 15 23:22:14 user nova-compute[76391]: No targets found.
Nov 15 23:22:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:22:14 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:22:14 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:22:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bd48e6-2456-4c61-9d3e-721940c7a082]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[279847cf-d088-42cf-9fca-8d06dd736695]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:15 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:15 user nova-compute[76391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed (non-flash)
Nov 15 23:22:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:15 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:15 user nova-compute[76391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed (non-flash)
Nov 15 23:22:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97600ec0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d53da47-3585-4f4a-923b-86bdb83d1012]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[651bc5e1-bbf1-4d50-b0eb-08eb3aba64c1]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c487ef-5bcc-49f7-b70f-c578fdc0c2bd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d58b8-63dd-4829-83d6-397fada2d0bf]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b982e2-6164-4524-8894-189c6622a096]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:22:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[237dc8e9-fcef-426d-b66f-4075af668d59]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260]
Nov 15 23:22:15 user nova-compute[76391]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed, portal: 172.16.0.220,3260] successful.
Nov 15 23:22:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f08d43-f93d-4ddc-9a3f-05cb693e4aed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb213ea-b242-42db-b0bb-70907f5103f0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] <== disconnect_volume: return (319ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:22:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Deleting instance files /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5_del
Nov 15 23:22:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Deletion of /opt/stack/data/nova/instances/d16e63a2-95bb-4709-960b-9518f4eb82e5_del complete
Nov 15 23:22:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc3fe8qvr/983746c3cc1b44019d65c644f02eb1a1.delta /opt/stack/data/nova/instances/snapshots/tmpc3fe8qvr/983746c3cc1b44019d65c644f02eb1a1 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:15 user nova-compute[76391]: INFO nova.compute.manager [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-changed-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Refreshing instance network info cache due to event network-changed-f6e3d304-aa96-4149-9ea5-9fb21f718c1c. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] Acquiring lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] Acquired lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG nova.network.neutron [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Refreshing network info cache for port f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:22:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc3fe8qvr/983746c3cc1b44019d65c644f02eb1a1.delta /opt/stack/data/nova/instances/snapshots/tmpc3fe8qvr/983746c3cc1b44019d65c644f02eb1a1" returned: 0 in 0.609s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Snapshot extracted, beginning image upload
Nov 15 23:22:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-4c768885-37cf-49b3-84b6-5445132c6a8f req-1675e2a6-efd0-4c51-b145-8e6d4d91c33d service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received event network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4c768885-37cf-49b3-84b6-5445132c6a8f req-1675e2a6-efd0-4c51-b145-8e6d4d91c33d service nova] Acquiring lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4c768885-37cf-49b3-84b6-5445132c6a8f req-1675e2a6-efd0-4c51-b145-8e6d4d91c33d service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4c768885-37cf-49b3-84b6-5445132c6a8f req-1675e2a6-efd0-4c51-b145-8e6d4d91c33d service nova] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-4c768885-37cf-49b3-84b6-5445132c6a8f req-1675e2a6-efd0-4c51-b145-8e6d4d91c33d service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] No waiting events found dispatching network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:16 user nova-compute[76391]: WARNING nova.compute.manager [req-4c768885-37cf-49b3-84b6-5445132c6a8f req-1675e2a6-efd0-4c51-b145-8e6d4d91c33d service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received unexpected event network-vif-plugged-d5454cae-68f5-4e35-ad54-9fc20f309d1e for instance with vm_state active and task_state deleting.
Nov 15 23:22:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updated VIF entry in instance network info cache for port f6e3d304-aa96-4149-9ea5-9fb21f718c1c. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5cf3ecb7-e688-4a39-889d-3af45b2a110c req-db9b8836-7621-4af9-b244-1dcb7b37ba28 service nova] Releasing lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:16 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:16 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Took 1.41 seconds to deallocate network for instance.
Nov 15 23:22:17 user nova-compute[76391]: INFO nova.compute.manager [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Took 0.83 seconds to detach 1 volumes for instance.
Nov 15 23:22:17 user nova-compute[76391]: DEBUG nova.compute.manager [req-8b956bc6-4116-4c52-9849-ba407d5ffdcd req-c0bd6d77-1f28-4bac-83e9-ef528a7d45b2 service nova] [instance: d16e63a2-95bb-4709-960b-9518f4eb82e5] Received event network-vif-deleted-d5454cae-68f5-4e35-ad54-9fc20f309d1e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:18 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:22:18 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:22:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:18 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Deleted allocations for instance d16e63a2-95bb-4709-960b-9518f4eb82e5
Nov 15 23:22:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1a9301aa-ec35-4851-aef4-1b932f6a76bc tempest-DeleteServersTestJSON-2070975080 tempest-DeleteServersTestJSON-2070975080-project-member] Lock "d16e63a2-95bb-4709-960b-9518f4eb82e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.303s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:19 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Snapshot image upload complete
Nov 15 23:22:19 user nova-compute[76391]: INFO nova.compute.manager [None req-5e10960b-8b2c-4160-8087-ec5211ebc0ea tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Took 6.54 seconds to snapshot the instance on the hypervisor.
Nov 15 23:22:19 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:19 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:22:25 user nova-compute[76391]: INFO nova.compute.claims [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Claim successful on node user
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6886MB free_disk=25.136199951171875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.957s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.083s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:22:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e08c5f26-850b-4d4a-89ab-88f2066acc71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance c28f3f3d-8148-4c30-8070-9acff631ab32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance f1b969e4-24ec-4b81-b9a9-54c29475d530 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.policy [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c229306bc594655839772e64b7f0200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852b0603a2849ae851780a32addfa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:22:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Creating image(s)
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "/opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "/opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "/opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "3d5ba90f870f67eed22c9b9506404612d13ce4a6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "3d5ba90f870f67eed22c9b9506404612d13ce4a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Successfully created port: 781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.part --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG nova.virt.images [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] e6611ead-79a2-44a1-9acb-fff332bbf42d was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.part /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.323s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.part /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.converted" returned: 0 in 0.499s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6.converted --force-share --output=json" returned: 0 in 0.242s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "3d5ba90f870f67eed22c9b9506404612d13ce4a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.496s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Successfully updated port: 781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquired lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing instance network info cache due to event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] Acquiring lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "3d5ba90f870f67eed22c9b9506404612d13ce4a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "3d5ba90f870f67eed22c9b9506404612d13ce4a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6,backing_fmt=raw /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6,backing_fmt=raw /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk 1073741824" returned: 0 in 0.063s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "3d5ba90f870f67eed22c9b9506404612d13ce4a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-changed-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Refreshing instance network info cache due to event network-changed-bfafef15-364d-43b4-956d-63cb6f9993dd. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] Acquiring lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] Acquired lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Refreshing network info cache for port bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Releasing lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance network_info: |[{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] Acquired lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Cannot resize image /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Ensure instance console log exists: /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Start _get_guest_xml network_info=[{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:22:22Z,direct_url=<?>,disk_format='qcow2',id=e6611ead-79a2-44a1-9acb-fff332bbf42d,min_disk=0,min_ram=0,name='tempest-scenario-img--767729664',owner='c852b0603a2849ae851780a32addfa7d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:22:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': 'e6611ead-79a2-44a1-9acb-fff332bbf42d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:22:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:22:22Z,direct_url=<?>,disk_format='qcow2',id=e6611ead-79a2-44a1-9acb-fff332bbf42d,min_disk=0,min_ram=0,name='tempest-scenario-img--767729664',owner='c852b0603a2849ae851780a32addfa7d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:22:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-207908557',display_name='tempest-TestMinimumBasicScenario-server-207908557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-207908557',id=26,image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkYU4BuRcH74JoL3RVML6EL7DS6qRsR9cfY+3DTDakIKucNvSAUnIFTxShDHS0SOWAgyhhEoXTw14YuJyqN6/kCPKKgLUYs30k8pdw4yFaw5TbMk/cWhl4p6Leb6BdXg==',key_name='tempest-TestMinimumBasicScenario-832030111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-rssk504e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:22:26Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=286506a2-7aa6-41f7-9572-38ef37ea2f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.objects.instance [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'pci_devices' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:22:28 user nova-compute[76391]:   <uuid>286506a2-7aa6-41f7-9572-38ef37ea2f7c</uuid>
Nov 15 23:22:28 user nova-compute[76391]:   <name>instance-0000001a</name>
Nov 15 23:22:28 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:22:28 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:22:28 user nova-compute[76391]:   <metadata>
Nov 15 23:22:28 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:22:28 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:22:28 user nova-compute[76391]:       <nova:name>tempest-TestMinimumBasicScenario-server-207908557</nova:name>
Nov 15 23:22:28 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:22:28</nova:creationTime>
Nov 15 23:22:28 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:22:28 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:22:28 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:22:28 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:22:28 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:22:28 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:22:28 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:22:28 user nova-compute[76391]:       <nova:owner>
Nov 15 23:22:28 user nova-compute[76391]:         <nova:user uuid="3c229306bc594655839772e64b7f0200">tempest-TestMinimumBasicScenario-1692035413-project-member</nova:user>
Nov 15 23:22:28 user nova-compute[76391]:         <nova:project uuid="c852b0603a2849ae851780a32addfa7d">tempest-TestMinimumBasicScenario-1692035413</nova:project>
Nov 15 23:22:28 user nova-compute[76391]:       </nova:owner>
Nov 15 23:22:28 user nova-compute[76391]:       <nova:root type="image" uuid="e6611ead-79a2-44a1-9acb-fff332bbf42d"/>
Nov 15 23:22:28 user nova-compute[76391]:       <nova:ports>
Nov 15 23:22:28 user nova-compute[76391]:         <nova:port uuid="781fe01d-4127-45bc-8c88-ad948d96bf42">
Nov 15 23:22:28 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:22:28 user nova-compute[76391]:         </nova:port>
Nov 15 23:22:28 user nova-compute[76391]:       </nova:ports>
Nov 15 23:22:28 user nova-compute[76391]:     </nova:instance>
Nov 15 23:22:28 user nova-compute[76391]:   </metadata>
Nov 15 23:22:28 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:22:28 user nova-compute[76391]:     <system>
Nov 15 23:22:28 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:22:28 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:22:28 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:22:28 user nova-compute[76391]:       <entry name="serial">286506a2-7aa6-41f7-9572-38ef37ea2f7c</entry>
Nov 15 23:22:28 user nova-compute[76391]:       <entry name="uuid">286506a2-7aa6-41f7-9572-38ef37ea2f7c</entry>
Nov 15 23:22:28 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:22:28 user nova-compute[76391]:     </system>
Nov 15 23:22:28 user nova-compute[76391]:   </sysinfo>
Nov 15 23:22:28 user nova-compute[76391]:   <os>
Nov 15 23:22:28 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:22:28 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:22:28 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:22:28 user nova-compute[76391]:   </os>
Nov 15 23:22:28 user nova-compute[76391]:   <features>
Nov 15 23:22:28 user nova-compute[76391]:     <acpi/>
Nov 15 23:22:28 user nova-compute[76391]:     <apic/>
Nov 15 23:22:28 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:22:28 user nova-compute[76391]:   </features>
Nov 15 23:22:28 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:22:28 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:22:28 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:22:28 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:22:28 user nova-compute[76391]:   </clock>
Nov 15 23:22:28 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:22:28 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:22:28 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:22:28 user nova-compute[76391]:   </cpu>
Nov 15 23:22:28 user nova-compute[76391]:   <devices>
Nov 15 23:22:28 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:22:28 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:22:28 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk"/>
Nov 15 23:22:28 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:22:28 user nova-compute[76391]:     </disk>
Nov 15 23:22:28 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:22:28 user nova-compute[76391]:       <mac address="fa:16:3e:c0:90:2f"/>
Nov 15 23:22:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:22:28 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:22:28 user nova-compute[76391]:       <target dev="tap781fe01d-41"/>
Nov 15 23:22:28 user nova-compute[76391]:     </interface>
Nov 15 23:22:28 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:22:28 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/console.log" append="off"/>
Nov 15 23:22:28 user nova-compute[76391]:     </serial>
Nov 15 23:22:28 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:22:28 user nova-compute[76391]:     <video>
Nov 15 23:22:28 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:22:28 user nova-compute[76391]:     </video>
Nov 15 23:22:28 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:22:28 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:22:28 user nova-compute[76391]:     </rng>
Nov 15 23:22:28 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:22:28 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:22:28 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:22:28 user nova-compute[76391]:     </memballoon>
Nov 15 23:22:28 user nova-compute[76391]:   </devices>
Nov 15 23:22:28 user nova-compute[76391]: </domain>
Nov 15 23:22:28 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-207908557',display_name='tempest-TestMinimumBasicScenario-server-207908557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-207908557',id=26,image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkYU4BuRcH74JoL3RVML6EL7DS6qRsR9cfY+3DTDakIKucNvSAUnIFTxShDHS0SOWAgyhhEoXTw14YuJyqN6/kCPKKgLUYs30k8pdw4yFaw5TbMk/cWhl4p6Leb6BdXg==',key_name='tempest-TestMinimumBasicScenario-832030111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-rssk504e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:22:26Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=286506a2-7aa6-41f7-9572-38ef37ea2f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG os_vif [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03d319da-c4c6-562c-9be5-73a80b48b603', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap781fe01d-41, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap781fe01d-41, col_values=(('qos', UUID('d7587a02-9a2f-42d0-9685-04ae24a99837')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap781fe01d-41, col_values=(('external_ids', {'iface-id': '781fe01d-4127-45bc-8c88-ad948d96bf42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:90:2f', 'vm-uuid': '286506a2-7aa6-41f7-9572-38ef37ea2f7c'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:28 user nova-compute[76391]: INFO os_vif [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41')
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:22:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No VIF found with MAC fa:16:3e:c0:90:2f, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:22:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updated VIF entry in instance network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:22:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-529296b1-e4a2-4231-a4cb-50282e649ba9 req-ec307b6d-0e65-4e53-9a9a-e38f79b93201 service nova] Releasing lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Updated VIF entry in instance network info cache for port bfafef15-364d-43b4-956d-63cb6f9993dd. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:22:29 user nova-compute[76391]: DEBUG nova.network.neutron [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Updating instance_info_cache with network_info: [{"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f1ca04d8-64ad-4649-85a8-16e96809bf54 req-d8a65ee3-46d9-4fb8-86bd-95bd8fa72c9c service nova] Releasing lock "refresh_cache-c28f3f3d-8148-4c30-8070-9acff631ab32" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-fed32080-f938-4e88-83fd-1233ac22c1e5 req-28a58260-f405-40b0-a97a-72eb9eae4394 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed32080-f938-4e88-83fd-1233ac22c1e5 req-28a58260-f405-40b0-a97a-72eb9eae4394 service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed32080-f938-4e88-83fd-1233ac22c1e5 req-28a58260-f405-40b0-a97a-72eb9eae4394 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fed32080-f938-4e88-83fd-1233ac22c1e5 req-28a58260-f405-40b0-a97a-72eb9eae4394 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-fed32080-f938-4e88-83fd-1233ac22c1e5 req-28a58260-f405-40b0-a97a-72eb9eae4394 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:30 user nova-compute[76391]: WARNING nova.compute.manager [req-fed32080-f938-4e88-83fd-1233ac22c1e5 req-28a58260-f405-40b0-a97a-72eb9eae4394 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received unexpected event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with vm_state building and task_state spawning.
Nov 15 23:22:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG nova.objects.instance [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid c28f3f3d-8148-4c30-8070-9acff631ab32 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:31 user nova-compute[76391]: INFO nova.compute.manager [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Attaching volume dfb9b491-240d-49c2-8283-e9e9a168901d to /dev/vdb
Nov 15 23:22:31 user nova-compute[76391]: DEBUG os_brick.utils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d6aac-ebe4-4743-a2b2-f4e18c802a77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0114d4d-0d77-4432-9b64-3d05295036b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0986c0-20ec-4b69-9393-721ff1cf1f17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34110247-f5ca-4222-9964-f7170015bf1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:22:31 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:22:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6486c2-affb-4c62-afea-22e01f498d93]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG os_brick.utils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:22:31 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Updating existing volume attachment record: 36ff2f9c-ef81-4e26-b65e-51026847676b {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:22:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance spawned successfully.
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf15a04a-05f6-4d26-b092-53b1df931d47 req-78c6b650-f4c9-49a0-a34a-03bc652b5300 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf15a04a-05f6-4d26-b092-53b1df931d47 req-78c6b650-f4c9-49a0-a34a-03bc652b5300 service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf15a04a-05f6-4d26-b092-53b1df931d47 req-78c6b650-f4c9-49a0-a34a-03bc652b5300 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf15a04a-05f6-4d26-b092-53b1df931d47 req-78c6b650-f4c9-49a0-a34a-03bc652b5300 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf15a04a-05f6-4d26-b092-53b1df931d47 req-78c6b650-f4c9-49a0-a34a-03bc652b5300 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:32 user nova-compute[76391]: WARNING nova.compute.manager [req-cf15a04a-05f6-4d26-b092-53b1df931d47 req-78c6b650-f4c9-49a0-a34a-03bc652b5300 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received unexpected event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with vm_state building and task_state spawning.
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:32 user nova-compute[76391]: INFO nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 15 23:22:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:22:32 user nova-compute[76391]: INFO nova.compute.manager [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Took 7.74 seconds to build instance.
Nov 15 23:22:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d315bff-4f43-4ccd-a689-5ec66fc27767 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.879s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:22:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:35 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:22:35 user nova-compute[76391]: INFO nova.compute.claims [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Claim successful on node user
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.network.neutron [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:22:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.policy [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45a3062019c454d8cc5321e130f8286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8145bb6c79f347f39e0a46758d3683ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:22:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Creating image(s)
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oruTcMpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:22:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:22:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:22:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:22:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:22:36 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b35bd-3212-49c1-bc53-7c5755a82437]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:22:36 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5216a895-b918-42af-9859-b37957765ace]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d] added
Nov 15 23:22:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9c5d8-f571-42d0-9868-993568d198c9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fac537-7a37-446e-b5bf-a02efc6e246c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oruTcMpZ {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oruTcMpZ" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049c124-3897-40c9-a2ce-9bebf4873cde]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oruTcMpZ'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738b773-4bb0-4c61-a016-9d07cfeac095]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36118aa-c53b-4323-b740-c7c23db834ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:37 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:37 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk 1073741824" returned: 0 in 0.079s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a71f34-356b-4b33-a161-80ab9269998a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260]
Nov 15 23:22:37 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260] successful.
Nov 15 23:22:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ee9c36-88f9-428c-8ee7-bdf033f832de]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de953272-3089-40b4-a2b6-f4f965c15e74]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:37 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:37 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:22:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:22:37 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:22:37 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:22:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa59627-b10a-4415-996b-fd6c999cc8ca]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oruTcMpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Successfully created port: 8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.220s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Cannot resize image /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Ensure instance console log exists: /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Successfully updated port: 8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquired lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-changed-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Refreshing instance network info cache due to event network-changed-8acb3576-ff3c-4297-9fd7-ee981710af13. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] Acquiring lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23732316139656532', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732316139656532', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid c28f3f3d-8148-4c30-8070-9acff631ab32 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:22:38 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:22:38 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:22:38 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:22:38 user nova-compute[76391]:   <serial>dfb9b491-240d-49c2-8283-e9e9a168901d</serial>
Nov 15 23:22:38 user nova-compute[76391]: </disk>
Nov 15 23:22:38 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Releasing lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance network_info: |[{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] Acquired lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.neutron [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Refreshing network info cache for port 8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Start _get_guest_xml network_info=[{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:22:38 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:38 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2092280647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2092280647',id=27,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUfeIkqisYhJfDtDT/7g9I/OkuxJxv/EWwZ+2KZOpmptwDdYd6iM/Tw9D5nSueupq99xMX7+T4pF4KMTFkJwL9pdjZYmqjAfPJifWRtQUFOuRUPTvsel158nyKFd1YQZg==',key_name='tempest-keypair-1514669977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-sqngh7cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=3045f654-72f4-44c7-bc80-92b1b9e549a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'pci_devices' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:22:38 user nova-compute[76391]:   <uuid>3045f654-72f4-44c7-bc80-92b1b9e549a8</uuid>
Nov 15 23:22:38 user nova-compute[76391]:   <name>instance-0000001b</name>
Nov 15 23:22:38 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:22:38 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:22:38 user nova-compute[76391]:   <metadata>
Nov 15 23:22:38 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:22:38 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:22:38 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2092280647</nova:name>
Nov 15 23:22:38 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:22:38</nova:creationTime>
Nov 15 23:22:38 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:22:38 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:22:38 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:22:38 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:22:38 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:22:38 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:22:38 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:22:38 user nova-compute[76391]:       <nova:owner>
Nov 15 23:22:38 user nova-compute[76391]:         <nova:user uuid="e45a3062019c454d8cc5321e130f8286">tempest-AttachVolumeShelveTestJSON-959550804-project-member</nova:user>
Nov 15 23:22:38 user nova-compute[76391]:         <nova:project uuid="8145bb6c79f347f39e0a46758d3683ff">tempest-AttachVolumeShelveTestJSON-959550804</nova:project>
Nov 15 23:22:38 user nova-compute[76391]:       </nova:owner>
Nov 15 23:22:38 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:22:38 user nova-compute[76391]:       <nova:ports>
Nov 15 23:22:38 user nova-compute[76391]:         <nova:port uuid="8acb3576-ff3c-4297-9fd7-ee981710af13">
Nov 15 23:22:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 23:22:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:22:38 user nova-compute[76391]:       </nova:ports>
Nov 15 23:22:38 user nova-compute[76391]:     </nova:instance>
Nov 15 23:22:38 user nova-compute[76391]:   </metadata>
Nov 15 23:22:38 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:22:38 user nova-compute[76391]:     <system>
Nov 15 23:22:38 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:22:38 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:22:38 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:22:38 user nova-compute[76391]:       <entry name="serial">3045f654-72f4-44c7-bc80-92b1b9e549a8</entry>
Nov 15 23:22:38 user nova-compute[76391]:       <entry name="uuid">3045f654-72f4-44c7-bc80-92b1b9e549a8</entry>
Nov 15 23:22:38 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:22:38 user nova-compute[76391]:     </system>
Nov 15 23:22:38 user nova-compute[76391]:   </sysinfo>
Nov 15 23:22:38 user nova-compute[76391]:   <os>
Nov 15 23:22:38 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:22:38 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:22:38 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:22:38 user nova-compute[76391]:   </os>
Nov 15 23:22:38 user nova-compute[76391]:   <features>
Nov 15 23:22:38 user nova-compute[76391]:     <acpi/>
Nov 15 23:22:38 user nova-compute[76391]:     <apic/>
Nov 15 23:22:38 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:22:38 user nova-compute[76391]:   </features>
Nov 15 23:22:38 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:22:38 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:22:38 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:22:38 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:22:38 user nova-compute[76391]:   </clock>
Nov 15 23:22:38 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:22:38 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:22:38 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:22:38 user nova-compute[76391]:   </cpu>
Nov 15 23:22:38 user nova-compute[76391]:   <devices>
Nov 15 23:22:38 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:22:38 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:22:38 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk"/>
Nov 15 23:22:38 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:22:38 user nova-compute[76391]:     </disk>
Nov 15 23:22:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:22:38 user nova-compute[76391]:       <mac address="fa:16:3e:c2:32:9c"/>
Nov 15 23:22:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:22:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:22:38 user nova-compute[76391]:       <target dev="tap8acb3576-ff"/>
Nov 15 23:22:38 user nova-compute[76391]:     </interface>
Nov 15 23:22:38 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:22:38 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/console.log" append="off"/>
Nov 15 23:22:38 user nova-compute[76391]:     </serial>
Nov 15 23:22:38 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:22:38 user nova-compute[76391]:     <video>
Nov 15 23:22:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:22:38 user nova-compute[76391]:     </video>
Nov 15 23:22:38 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:22:38 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:22:38 user nova-compute[76391]:     </rng>
Nov 15 23:22:38 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:22:38 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:22:38 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:22:38 user nova-compute[76391]:     </memballoon>
Nov 15 23:22:38 user nova-compute[76391]:   </devices>
Nov 15 23:22:38 user nova-compute[76391]: </domain>
Nov 15 23:22:38 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2092280647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2092280647',id=27,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUfeIkqisYhJfDtDT/7g9I/OkuxJxv/EWwZ+2KZOpmptwDdYd6iM/Tw9D5nSueupq99xMX7+T4pF4KMTFkJwL9pdjZYmqjAfPJifWRtQUFOuRUPTvsel158nyKFd1YQZg==',key_name='tempest-keypair-1514669977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-sqngh7cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=3045f654-72f4-44c7-bc80-92b1b9e549a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG os_vif [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '535179be-f81b-5d06-9f1a-aa95e8f645d3', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8acb3576-ff, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8acb3576-ff, col_values=(('qos', UUID('21c835ad-27d0-4c2f-8fe5-af906f37fd45')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8acb3576-ff, col_values=(('external_ids', {'iface-id': '8acb3576-ff3c-4297-9fd7-ee981710af13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:32:9c', 'vm-uuid': '3045f654-72f4-44c7-bc80-92b1b9e549a8'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:38 user nova-compute[76391]: INFO os_vif [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff')
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No VIF found with MAC fa:16:3e:c2:32:9c, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No VIF found with MAC fa:16:3e:5e:70:3d, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.neutron [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updated VIF entry in instance network info cache for port 8acb3576-ff3c-4297-9fd7-ee981710af13. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG nova.network.neutron [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c1255d2b-9b5e-4998-b194-bc297f027073 req-2e4df481-6725-4479-9a1c-dbf6e4fd8e03 service nova] Releasing lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa771b7d-c1cc-4eab-9904-6a8ee047608c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.401s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-884c1a1c-31ed-44d3-9025-50c5f54b1b46 req-aab135f7-119f-4ac9-8485-2e4c8abf31ca service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-884c1a1c-31ed-44d3-9025-50c5f54b1b46 req-aab135f7-119f-4ac9-8485-2e4c8abf31ca service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-884c1a1c-31ed-44d3-9025-50c5f54b1b46 req-aab135f7-119f-4ac9-8485-2e4c8abf31ca service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-884c1a1c-31ed-44d3-9025-50c5f54b1b46 req-aab135f7-119f-4ac9-8485-2e4c8abf31ca service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-884c1a1c-31ed-44d3-9025-50c5f54b1b46 req-aab135f7-119f-4ac9-8485-2e4c8abf31ca service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:40 user nova-compute[76391]: WARNING nova.compute.manager [req-884c1a1c-31ed-44d3-9025-50c5f54b1b46 req-aab135f7-119f-4ac9-8485-2e4c8abf31ca service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received unexpected event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with vm_state building and task_state spawning.
Nov 15 23:22:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:22:42 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance spawned successfully.
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:42 user nova-compute[76391]: INFO nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c321a8f4-8732-4ba1-afb2-e17ca757794c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-75d8a73c-a677-419d-adfd-955119e25715 req-e054b0ae-1fd3-4095-868a-e6ca38b40bbc service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-75d8a73c-a677-419d-adfd-955119e25715 req-e054b0ae-1fd3-4095-868a-e6ca38b40bbc service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-75d8a73c-a677-419d-adfd-955119e25715 req-e054b0ae-1fd3-4095-868a-e6ca38b40bbc service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-75d8a73c-a677-419d-adfd-955119e25715 req-e054b0ae-1fd3-4095-868a-e6ca38b40bbc service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-75d8a73c-a677-419d-adfd-955119e25715 req-e054b0ae-1fd3-4095-868a-e6ca38b40bbc service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:42 user nova-compute[76391]: WARNING nova.compute.manager [req-75d8a73c-a677-419d-adfd-955119e25715 req-e054b0ae-1fd3-4095-868a-e6ca38b40bbc service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received unexpected event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with vm_state building and task_state spawning.
Nov 15 23:22:42 user nova-compute[76391]: INFO nova.compute.manager [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Took 6.72 seconds to build instance.
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7031c8d1-1ff4-4d52-9415-d96a6355211a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.821s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:42 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:22:42 user nova-compute[76391]: INFO nova.compute.claims [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Claim successful on node user
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:22:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.policy [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a0dc5a4052f4e9ebf3448d0ed5e5f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0d9ceea4a4748c4a4524ffb24a56e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:22:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Creating image(s)
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "/opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.229s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk 1073741824" returned: 0 in 0.049s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.213s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Successfully created port: 3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Cannot resize image /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Ensure instance console log exists: /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Successfully updated port: 3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquired lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-changed-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Refreshing instance network info cache due to event network-changed-3f8a3ffc-04a1-4462-8421-1258e8e489bf. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] Acquiring lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Updating instance_info_cache with network_info: [{"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Releasing lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Instance network_info: |[{"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] Acquired lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Refreshing network info cache for port 3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Start _get_guest_xml network_info=[{"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:22:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323482703',display_name='tempest-AttachVolumeNegativeTest-server-1323482703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323482703',id=28,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYgc2tBPUW0LE+/sfGgnaa4rlHvkjUKSTb0iXuI3qb0RIsccMira9FPwkZfszxSzdqHZ9kpLLF2do3Js9BSpKmrQdpz2td69EsnDdfE/bHEqUsMPpthHxVcs2hwTxRNxQ==',key_name='tempest-keypair-760532890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-866np29c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=c321a8f4-8732-4ba1-afb2-e17ca757794c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4f:11,bridge_name='br-int',has_traffic_filtering=True,id=3f8a3ffc-04a1-4462-8421-1258e8e489bf,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f8a3ffc-04') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.objects.instance [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'pci_devices' on Instance uuid c321a8f4-8732-4ba1-afb2-e17ca757794c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:22:45 user nova-compute[76391]:   <uuid>c321a8f4-8732-4ba1-afb2-e17ca757794c</uuid>
Nov 15 23:22:45 user nova-compute[76391]:   <name>instance-0000001c</name>
Nov 15 23:22:45 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:22:45 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:22:45 user nova-compute[76391]:   <metadata>
Nov 15 23:22:45 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:22:45 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:22:45 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1323482703</nova:name>
Nov 15 23:22:45 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:22:45</nova:creationTime>
Nov 15 23:22:45 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:22:45 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:22:45 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:22:45 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:22:45 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:22:45 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:22:45 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:22:45 user nova-compute[76391]:       <nova:owner>
Nov 15 23:22:45 user nova-compute[76391]:         <nova:user uuid="9a0dc5a4052f4e9ebf3448d0ed5e5f2a">tempest-AttachVolumeNegativeTest-511423013-project-member</nova:user>
Nov 15 23:22:45 user nova-compute[76391]:         <nova:project uuid="f0d9ceea4a4748c4a4524ffb24a56e97">tempest-AttachVolumeNegativeTest-511423013</nova:project>
Nov 15 23:22:45 user nova-compute[76391]:       </nova:owner>
Nov 15 23:22:45 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:22:45 user nova-compute[76391]:       <nova:ports>
Nov 15 23:22:45 user nova-compute[76391]:         <nova:port uuid="3f8a3ffc-04a1-4462-8421-1258e8e489bf">
Nov 15 23:22:45 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 23:22:45 user nova-compute[76391]:         </nova:port>
Nov 15 23:22:45 user nova-compute[76391]:       </nova:ports>
Nov 15 23:22:45 user nova-compute[76391]:     </nova:instance>
Nov 15 23:22:45 user nova-compute[76391]:   </metadata>
Nov 15 23:22:45 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:22:45 user nova-compute[76391]:     <system>
Nov 15 23:22:45 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:22:45 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:22:45 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:22:45 user nova-compute[76391]:       <entry name="serial">c321a8f4-8732-4ba1-afb2-e17ca757794c</entry>
Nov 15 23:22:45 user nova-compute[76391]:       <entry name="uuid">c321a8f4-8732-4ba1-afb2-e17ca757794c</entry>
Nov 15 23:22:45 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:22:45 user nova-compute[76391]:     </system>
Nov 15 23:22:45 user nova-compute[76391]:   </sysinfo>
Nov 15 23:22:45 user nova-compute[76391]:   <os>
Nov 15 23:22:45 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:22:45 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:22:45 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:22:45 user nova-compute[76391]:   </os>
Nov 15 23:22:45 user nova-compute[76391]:   <features>
Nov 15 23:22:45 user nova-compute[76391]:     <acpi/>
Nov 15 23:22:45 user nova-compute[76391]:     <apic/>
Nov 15 23:22:45 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:22:45 user nova-compute[76391]:   </features>
Nov 15 23:22:45 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:22:45 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:22:45 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:22:45 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:22:45 user nova-compute[76391]:   </clock>
Nov 15 23:22:45 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:22:45 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:22:45 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:22:45 user nova-compute[76391]:   </cpu>
Nov 15 23:22:45 user nova-compute[76391]:   <devices>
Nov 15 23:22:45 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:22:45 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:22:45 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk"/>
Nov 15 23:22:45 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:22:45 user nova-compute[76391]:     </disk>
Nov 15 23:22:45 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:22:45 user nova-compute[76391]:       <mac address="fa:16:3e:66:4f:11"/>
Nov 15 23:22:45 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:22:45 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:22:45 user nova-compute[76391]:       <target dev="tap3f8a3ffc-04"/>
Nov 15 23:22:45 user nova-compute[76391]:     </interface>
Nov 15 23:22:45 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:22:45 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/console.log" append="off"/>
Nov 15 23:22:45 user nova-compute[76391]:     </serial>
Nov 15 23:22:45 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:22:45 user nova-compute[76391]:     <video>
Nov 15 23:22:45 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:22:45 user nova-compute[76391]:     </video>
Nov 15 23:22:45 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:22:45 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:22:45 user nova-compute[76391]:     </rng>
Nov 15 23:22:45 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:22:45 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:22:45 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:22:45 user nova-compute[76391]:     </memballoon>
Nov 15 23:22:45 user nova-compute[76391]:   </devices>
Nov 15 23:22:45 user nova-compute[76391]: </domain>
Nov 15 23:22:45 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323482703',display_name='tempest-AttachVolumeNegativeTest-server-1323482703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323482703',id=28,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYgc2tBPUW0LE+/sfGgnaa4rlHvkjUKSTb0iXuI3qb0RIsccMira9FPwkZfszxSzdqHZ9kpLLF2do3Js9BSpKmrQdpz2td69EsnDdfE/bHEqUsMPpthHxVcs2hwTxRNxQ==',key_name='tempest-keypair-760532890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-866np29c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=c321a8f4-8732-4ba1-afb2-e17ca757794c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4f:11,bridge_name='br-int',has_traffic_filtering=True,id=3f8a3ffc-04a1-4462-8421-1258e8e489bf,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f8a3ffc-04') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG os_vif [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4f:11,bridge_name='br-int',has_traffic_filtering=True,id=3f8a3ffc-04a1-4462-8421-1258e8e489bf,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f8a3ffc-04') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ed6e10e-a247-59b8-9d10-17258636c1bf', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f8a3ffc-04, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f8a3ffc-04, col_values=(('qos', UUID('332888c8-c693-44c9-b704-43e5dd4cab1d')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f8a3ffc-04, col_values=(('external_ids', {'iface-id': '3f8a3ffc-04a1-4462-8421-1258e8e489bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:4f:11', 'vm-uuid': 'c321a8f4-8732-4ba1-afb2-e17ca757794c'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:45 user nova-compute[76391]: INFO os_vif [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4f:11,bridge_name='br-int',has_traffic_filtering=True,id=3f8a3ffc-04a1-4462-8421-1258e8e489bf,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f8a3ffc-04')
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:22:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No VIF found with MAC fa:16:3e:66:4f:11, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Updated VIF entry in instance network info cache for port 3f8a3ffc-04a1-4462-8421-1258e8e489bf. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Updating instance_info_cache with network_info: [{"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aeb3632d-dd7e-4331-96df-00153c708f05 req-dceb80bc-a668-434c-84a5-6136133a7bdf service nova] Releasing lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:46 user nova-compute[76391]: INFO nova.compute.manager [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Terminating instance
Nov 15 23:22:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-2ee17165-32b0-4b19-86f6-1574cd83d83d req-b0922a1f-cb7a-4543-aa50-035141b618cb service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-unplugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2ee17165-32b0-4b19-86f6-1574cd83d83d req-b0922a1f-cb7a-4543-aa50-035141b618cb service nova] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2ee17165-32b0-4b19-86f6-1574cd83d83d req-b0922a1f-cb7a-4543-aa50-035141b618cb service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2ee17165-32b0-4b19-86f6-1574cd83d83d req-b0922a1f-cb7a-4543-aa50-035141b618cb service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-2ee17165-32b0-4b19-86f6-1574cd83d83d req-b0922a1f-cb7a-4543-aa50-035141b618cb service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] No waiting events found dispatching network-vif-unplugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-2ee17165-32b0-4b19-86f6-1574cd83d83d req-b0922a1f-cb7a-4543-aa50-035141b618cb service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-unplugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-5177f4c1-a588-4c71-8d16-e1e282762885 req-d527cb02-2788-4d1e-aac6-894ec7a2e050 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5177f4c1-a588-4c71-8d16-e1e282762885 req-d527cb02-2788-4d1e-aac6-894ec7a2e050 service nova] Acquiring lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5177f4c1-a588-4c71-8d16-e1e282762885 req-d527cb02-2788-4d1e-aac6-894ec7a2e050 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5177f4c1-a588-4c71-8d16-e1e282762885 req-d527cb02-2788-4d1e-aac6-894ec7a2e050 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-5177f4c1-a588-4c71-8d16-e1e282762885 req-d527cb02-2788-4d1e-aac6-894ec7a2e050 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] No waiting events found dispatching network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:47 user nova-compute[76391]: WARNING nova.compute.manager [req-5177f4c1-a588-4c71-8d16-e1e282762885 req-d527cb02-2788-4d1e-aac6-894ec7a2e050 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received unexpected event network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf for instance with vm_state building and task_state spawning.
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Instance destroyed successfully.
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lazy-loading 'resources' on Instance uuid f1b969e4-24ec-4b81-b9a9-54c29475d530 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-587303725',display_name='tempest-VolumesActionsTest-instance-587303725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-587303725',id=24,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:20:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed4867a9ccd74893a5d0f6548dd0d26d',ramdisk_id='',reservation_id='r-g2a8jii9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-751216714',owner_user_name='tempest-VolumesActionsTest-751216714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:20:57Z,user_data=None,user_id='31c9241ef07041ddbe7266b4566d77a2',uuid=f1b969e4-24ec-4b81-b9a9-54c29475d530,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Converting VIF {"id": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "address": "fa:16:3e:6c:bd:de", "network": {"id": "4bb92ada-e377-4644-856d-5113792b56f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1910227129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4867a9ccd74893a5d0f6548dd0d26d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ac94a8-14", "ovs_interfaceid": "19ac94a8-142a-4ab8-b18c-25c544352bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=19ac94a8-142a-4ab8-b18c-25c544352bd0,network=Network(4bb92ada-e377-4644-856d-5113792b56f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ac94a8-14') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:22:47 user nova-compute[76391]: DEBUG os_vif [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=19ac94a8-142a-4ab8-b18c-25c544352bd0,network=Network(4bb92ada-e377-4644-856d-5113792b56f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ac94a8-14') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19ac94a8-14, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5a5b491-e3b9-40b0-9ebe-896eda25cfea) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: INFO os_vif [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=19ac94a8-142a-4ab8-b18c-25c544352bd0,network=Network(4bb92ada-e377-4644-856d-5113792b56f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ac94a8-14')
Nov 15 23:22:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Deleting instance files /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530_del
Nov 15 23:22:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Deletion of /opt/stack/data/nova/instances/f1b969e4-24ec-4b81-b9a9-54c29475d530_del complete
Nov 15 23:22:48 user nova-compute[76391]: INFO nova.compute.manager [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 23:22:48 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:49 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Took 0.97 seconds to deallocate network for instance.
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] No waiting events found dispatching network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:49 user nova-compute[76391]: WARNING nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received unexpected event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 for instance with vm_state deleted and task_state None.
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] No waiting events found dispatching network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:49 user nova-compute[76391]: WARNING nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received unexpected event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 for instance with vm_state deleted and task_state None.
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] No waiting events found dispatching network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:49 user nova-compute[76391]: WARNING nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received unexpected event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 for instance with vm_state deleted and task_state None.
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-ab4cea80-ece1-4cef-a3f5-a7843acc9967 req-f979d838-3e62-4136-ad7c-6a05527e8c06 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-deleted-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-a9444d76-6b50-4a99-84fc-de22e22a262f req-52d76967-04fb-45eb-8570-d9d8006cd5e3 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a9444d76-6b50-4a99-84fc-de22e22a262f req-52d76967-04fb-45eb-8570-d9d8006cd5e3 service nova] Acquiring lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a9444d76-6b50-4a99-84fc-de22e22a262f req-52d76967-04fb-45eb-8570-d9d8006cd5e3 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a9444d76-6b50-4a99-84fc-de22e22a262f req-52d76967-04fb-45eb-8570-d9d8006cd5e3 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-a9444d76-6b50-4a99-84fc-de22e22a262f req-52d76967-04fb-45eb-8570-d9d8006cd5e3 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] No waiting events found dispatching network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:49 user nova-compute[76391]: WARNING nova.compute.manager [req-a9444d76-6b50-4a99-84fc-de22e22a262f req-52d76967-04fb-45eb-8570-d9d8006cd5e3 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received unexpected event network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf for instance with vm_state building and task_state spawning.
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:49 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Deleted allocations for instance f1b969e4-24ec-4b81-b9a9-54c29475d530
Nov 15 23:22:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42723ce5-c45b-41a7-ba1b-9bcf34abce9d tempest-VolumesActionsTest-751216714 tempest-VolumesActionsTest-751216714-project-member] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.960s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:22:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Instance spawned successfully.
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:22:50 user nova-compute[76391]: INFO nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 15 23:22:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:22:50 user nova-compute[76391]: INFO nova.compute.manager [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Took 7.56 seconds to build instance.
Nov 15 23:22:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1db79861-f302-47cc-b3ef-66c5bb8e96fc tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.679s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-ecc56603-2970-4d15-a06b-19a39a4d8065 req-8833b980-45ff-4407-bf2a-b24071b260b3 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ecc56603-2970-4d15-a06b-19a39a4d8065 req-8833b980-45ff-4407-bf2a-b24071b260b3 service nova] Acquiring lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ecc56603-2970-4d15-a06b-19a39a4d8065 req-8833b980-45ff-4407-bf2a-b24071b260b3 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ecc56603-2970-4d15-a06b-19a39a4d8065 req-8833b980-45ff-4407-bf2a-b24071b260b3 service nova] Lock "f1b969e4-24ec-4b81-b9a9-54c29475d530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-ecc56603-2970-4d15-a06b-19a39a4d8065 req-8833b980-45ff-4407-bf2a-b24071b260b3 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] No waiting events found dispatching network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:51 user nova-compute[76391]: WARNING nova.compute.manager [req-ecc56603-2970-4d15-a06b-19a39a4d8065 req-8833b980-45ff-4407-bf2a-b24071b260b3 service nova] [instance: f1b969e4-24ec-4b81-b9a9-54c29475d530] Received unexpected event network-vif-plugged-19ac94a8-142a-4ab8-b18c-25c544352bd0 for instance with vm_state deleted and task_state None.
Nov 15 23:22:51 user nova-compute[76391]: INFO nova.compute.manager [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Unrescuing
Nov 15 23:22:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:22:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:22:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'flavor' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-746a1a24-1212-4bf0-84b0-1b7a721e2e84 req-7183017e-340d-41cc-b52f-cc9b43980473 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-746a1a24-1212-4bf0-84b0-1b7a721e2e84 req-7183017e-340d-41cc-b52f-cc9b43980473 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-746a1a24-1212-4bf0-84b0-1b7a721e2e84 req-7183017e-340d-41cc-b52f-cc9b43980473 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-746a1a24-1212-4bf0-84b0-1b7a721e2e84 req-7183017e-340d-41cc-b52f-cc9b43980473 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-746a1a24-1212-4bf0-84b0-1b7a721e2e84 req-7183017e-340d-41cc-b52f-cc9b43980473 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:52 user nova-compute[76391]: WARNING nova.compute.manager [req-746a1a24-1212-4bf0-84b0-1b7a721e2e84 req-7183017e-340d-41cc-b52f-cc9b43980473 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:22:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance destroyed successfully.
Nov 15 23:22:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:54 user nova-compute[76391]: WARNING nova.compute.manager [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:22:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:54 user nova-compute[76391]: WARNING nova.compute.manager [req-c18fd175-21ad-472f-9c67-4bef13753ed4 req-bad94bd9-3d71-4810-847b-70b829652b77 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:22:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:22:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ccd21095-b851-4930-874a-7aaf082b66f6 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:22:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4fc94c7-2535-4842-8421-69c3f551fa4e req-1e000319-d519-48dd-a457-27c8efb36182 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:22:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4fc94c7-2535-4842-8421-69c3f551fa4e req-1e000319-d519-48dd-a457-27c8efb36182 service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:22:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4fc94c7-2535-4842-8421-69c3f551fa4e req-1e000319-d519-48dd-a457-27c8efb36182 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:22:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4fc94c7-2535-4842-8421-69c3f551fa4e req-1e000319-d519-48dd-a457-27c8efb36182 service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:22:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4fc94c7-2535-4842-8421-69c3f551fa4e req-1e000319-d519-48dd-a457-27c8efb36182 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:22:56 user nova-compute[76391]: WARNING nova.compute.manager [req-b4fc94c7-2535-4842-8421-69c3f551fa4e req-1e000319-d519-48dd-a457-27c8efb36182 service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state None.
Nov 15 23:22:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:09 user nova-compute[76391]: INFO nova.compute.manager [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Terminating instance
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-82c21980-1c15-4928-aa91-ace0531f6fef req-535135b7-8991-4459-8ba1-bf6722992943 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received event network-vif-unplugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-82c21980-1c15-4928-aa91-ace0531f6fef req-535135b7-8991-4459-8ba1-bf6722992943 service nova] Acquiring lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-82c21980-1c15-4928-aa91-ace0531f6fef req-535135b7-8991-4459-8ba1-bf6722992943 service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-82c21980-1c15-4928-aa91-ace0531f6fef req-535135b7-8991-4459-8ba1-bf6722992943 service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-82c21980-1c15-4928-aa91-ace0531f6fef req-535135b7-8991-4459-8ba1-bf6722992943 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] No waiting events found dispatching network-vif-unplugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-82c21980-1c15-4928-aa91-ace0531f6fef req-535135b7-8991-4459-8ba1-bf6722992943 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received event network-vif-unplugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Instance destroyed successfully.
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.objects.instance [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lazy-loading 'resources' on Instance uuid f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2131804714',display_name='tempest-ServersNegativeTestJSON-server-2131804714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2131804714',id=25,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bc691a9d5674fbb898dd6736e91613f',ramdisk_id='',reservation_id='r-yzurdg05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-686980340',owner_user_name='tempest-ServersNegativeTestJSON-686980340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:21:28Z,user_data=None,user_id='9d5fb40133174f4db6f71696591de2a8',uuid=f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converting VIF {"id": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "address": "fa:16:3e:a2:d3:7a", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap977e6da8-a0", "ovs_interfaceid": "977e6da8-a014-42ea-b0d4-9045d3fb6df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d3:7a,bridge_name='br-int',has_traffic_filtering=True,id=977e6da8-a014-42ea-b0d4-9045d3fb6df9,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap977e6da8-a0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG os_vif [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d3:7a,bridge_name='br-int',has_traffic_filtering=True,id=977e6da8-a014-42ea-b0d4-9045d3fb6df9,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap977e6da8-a0') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap977e6da8-a0, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f771ceee-f4a5-4c10-97c2-b3ad4ff0ec5a) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:09 user nova-compute[76391]: INFO os_vif [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d3:7a,bridge_name='br-int',has_traffic_filtering=True,id=977e6da8-a014-42ea-b0d4-9045d3fb6df9,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap977e6da8-a0')
Nov 15 23:23:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Deleting instance files /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6_del
Nov 15 23:23:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Deletion of /opt/stack/data/nova/instances/f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6_del complete
Nov 15 23:23:09 user nova-compute[76391]: INFO nova.compute.manager [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 23:23:09 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:23:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:10 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:23:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:10 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Took 0.49 seconds to deallocate network for instance.
Nov 15 23:23:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:10 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:23:10 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:23:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:10 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Deleted allocations for instance f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6
Nov 15 23:23:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cc87f4bd-cd5e-4c89-a956-9202c9aac041 tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.770s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-d31371be-05eb-405b-a2e4-3370bac75923 req-fc6e2433-38bf-45c6-b1de-78d048989fc8 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received event network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:23:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d31371be-05eb-405b-a2e4-3370bac75923 req-fc6e2433-38bf-45c6-b1de-78d048989fc8 service nova] Acquiring lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d31371be-05eb-405b-a2e4-3370bac75923 req-fc6e2433-38bf-45c6-b1de-78d048989fc8 service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d31371be-05eb-405b-a2e4-3370bac75923 req-fc6e2433-38bf-45c6-b1de-78d048989fc8 service nova] Lock "f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-d31371be-05eb-405b-a2e4-3370bac75923 req-fc6e2433-38bf-45c6-b1de-78d048989fc8 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] No waiting events found dispatching network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:23:11 user nova-compute[76391]: WARNING nova.compute.manager [req-d31371be-05eb-405b-a2e4-3370bac75923 req-fc6e2433-38bf-45c6-b1de-78d048989fc8 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received unexpected event network-vif-plugged-977e6da8-a014-42ea-b0d4-9045d3fb6df9 for instance with vm_state deleted and task_state None.
Nov 15 23:23:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-d31371be-05eb-405b-a2e4-3370bac75923 req-fc6e2433-38bf-45c6-b1de-78d048989fc8 service nova] [instance: f3d2366d-fe7c-4ff6-8fa1-95e22c3959b6] Received event network-vif-deleted-977e6da8-a014-42ea-b0d4-9045d3fb6df9 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updating instance_info_cache with network_info: [{"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-e08c5f26-850b-4d4a-89ab-88f2066acc71" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:23:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:23:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:15 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:23:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:23:25 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6965MB free_disk=25.033905029296875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:23:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e08c5f26-850b-4d4a-89ab-88f2066acc71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance c28f3f3d-8148-4c30-8070-9acff631ab32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance c321a8f4-8732-4ba1-afb2-e17ca757794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:23:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:23:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:23:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:23:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "74d8883b-5873-42d1-ad25-6c8d80725a72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:23:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:23:38 user nova-compute[76391]: INFO nova.compute.claims [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Claim successful on node user
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:23:39 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:23:39 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Creating image(s)
Nov 15 23:23:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "/opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "/opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "/opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:39 user nova-compute[76391]: DEBUG nova.policy [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a17891477dca4dab81721bf165483d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768e4948c25b4fa6b5de7019c2d8d2d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.253s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk 1073741824" returned: 0 in 0.054s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Successfully created port: a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Cannot resize image /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Ensure instance console log exists: /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Successfully updated port: a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "refresh_cache-74d8883b-5873-42d1-ad25-6c8d80725a72" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquired lock "refresh_cache-74d8883b-5873-42d1-ad25-6c8d80725a72" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received event network-changed-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Refreshing instance network info cache due to event network-changed-a3b3255e-5c2c-486a-975f-0769b0ad0d7c. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] Acquiring lock "refresh_cache-74d8883b-5873-42d1-ad25-6c8d80725a72" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Updating instance_info_cache with network_info: [{"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Releasing lock "refresh_cache-74d8883b-5873-42d1-ad25-6c8d80725a72" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Instance network_info: |[{"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] Acquired lock "refresh_cache-74d8883b-5873-42d1-ad25-6c8d80725a72" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.neutron [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Refreshing network info cache for port a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Start _get_guest_xml network_info=[{"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:23:41 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:23:41 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:23:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2030946676',display_name='tempest-VolumesNegativeTest-instance-2030946676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2030946676',id=29,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='768e4948c25b4fa6b5de7019c2d8d2d9',ramdisk_id='',reservation_id='r-nbxgtpf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-552600431',owner_user_name='tempest-VolumesNegativeTest-552600431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:23:40Z,user_data=None,user_id='a17891477dca4dab81721bf165483d84',uuid=74d8883b-5873-42d1-ad25-6c8d80725a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Converting VIF {"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:65,bridge_name='br-int',has_traffic_filtering=True,id=a3b3255e-5c2c-486a-975f-0769b0ad0d7c,network=Network(f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b3255e-5c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lazy-loading 'pci_devices' on Instance uuid 74d8883b-5873-42d1-ad25-6c8d80725a72 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:23:41 user nova-compute[76391]:   <uuid>74d8883b-5873-42d1-ad25-6c8d80725a72</uuid>
Nov 15 23:23:41 user nova-compute[76391]:   <name>instance-0000001d</name>
Nov 15 23:23:41 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:23:41 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:23:41 user nova-compute[76391]:   <metadata>
Nov 15 23:23:41 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:23:41 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:23:41 user nova-compute[76391]:       <nova:name>tempest-VolumesNegativeTest-instance-2030946676</nova:name>
Nov 15 23:23:41 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:23:41</nova:creationTime>
Nov 15 23:23:41 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:23:41 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:23:41 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:23:41 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:23:41 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:23:41 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:23:41 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:23:41 user nova-compute[76391]:       <nova:owner>
Nov 15 23:23:41 user nova-compute[76391]:         <nova:user uuid="a17891477dca4dab81721bf165483d84">tempest-VolumesNegativeTest-552600431-project-member</nova:user>
Nov 15 23:23:41 user nova-compute[76391]:         <nova:project uuid="768e4948c25b4fa6b5de7019c2d8d2d9">tempest-VolumesNegativeTest-552600431</nova:project>
Nov 15 23:23:41 user nova-compute[76391]:       </nova:owner>
Nov 15 23:23:41 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:23:41 user nova-compute[76391]:       <nova:ports>
Nov 15 23:23:41 user nova-compute[76391]:         <nova:port uuid="a3b3255e-5c2c-486a-975f-0769b0ad0d7c">
Nov 15 23:23:41 user nova-compute[76391]:           <nova:ip type="fixed" address="192.168.233.113" ipVersion="4"/>
Nov 15 23:23:41 user nova-compute[76391]:         </nova:port>
Nov 15 23:23:41 user nova-compute[76391]:       </nova:ports>
Nov 15 23:23:41 user nova-compute[76391]:     </nova:instance>
Nov 15 23:23:41 user nova-compute[76391]:   </metadata>
Nov 15 23:23:41 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:23:41 user nova-compute[76391]:     <system>
Nov 15 23:23:41 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:23:41 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:23:41 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:23:41 user nova-compute[76391]:       <entry name="serial">74d8883b-5873-42d1-ad25-6c8d80725a72</entry>
Nov 15 23:23:41 user nova-compute[76391]:       <entry name="uuid">74d8883b-5873-42d1-ad25-6c8d80725a72</entry>
Nov 15 23:23:41 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:23:41 user nova-compute[76391]:     </system>
Nov 15 23:23:41 user nova-compute[76391]:   </sysinfo>
Nov 15 23:23:41 user nova-compute[76391]:   <os>
Nov 15 23:23:41 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:23:41 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:23:41 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:23:41 user nova-compute[76391]:   </os>
Nov 15 23:23:41 user nova-compute[76391]:   <features>
Nov 15 23:23:41 user nova-compute[76391]:     <acpi/>
Nov 15 23:23:41 user nova-compute[76391]:     <apic/>
Nov 15 23:23:41 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:23:41 user nova-compute[76391]:   </features>
Nov 15 23:23:41 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:23:41 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:23:41 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:23:41 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:23:41 user nova-compute[76391]:   </clock>
Nov 15 23:23:41 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:23:41 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:23:41 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:23:41 user nova-compute[76391]:   </cpu>
Nov 15 23:23:41 user nova-compute[76391]:   <devices>
Nov 15 23:23:41 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:23:41 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:23:41 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk"/>
Nov 15 23:23:41 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:23:41 user nova-compute[76391]:     </disk>
Nov 15 23:23:41 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:23:41 user nova-compute[76391]:       <mac address="fa:16:3e:05:29:65"/>
Nov 15 23:23:41 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:23:41 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:23:41 user nova-compute[76391]:       <target dev="tapa3b3255e-5c"/>
Nov 15 23:23:41 user nova-compute[76391]:     </interface>
Nov 15 23:23:41 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:23:41 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/console.log" append="off"/>
Nov 15 23:23:41 user nova-compute[76391]:     </serial>
Nov 15 23:23:41 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:23:41 user nova-compute[76391]:     <video>
Nov 15 23:23:41 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:23:41 user nova-compute[76391]:     </video>
Nov 15 23:23:41 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:23:41 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:23:41 user nova-compute[76391]:     </rng>
Nov 15 23:23:41 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:23:41 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:23:41 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:23:41 user nova-compute[76391]:     </memballoon>
Nov 15 23:23:41 user nova-compute[76391]:   </devices>
Nov 15 23:23:41 user nova-compute[76391]: </domain>
Nov 15 23:23:41 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:23:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2030946676',display_name='tempest-VolumesNegativeTest-instance-2030946676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2030946676',id=29,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='768e4948c25b4fa6b5de7019c2d8d2d9',ramdisk_id='',reservation_id='r-nbxgtpf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-552600431',owner_user_name='tempest-VolumesNegativeTest-552600431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:23:40Z,user_data=None,user_id='a17891477dca4dab81721bf165483d84',uuid=74d8883b-5873-42d1-ad25-6c8d80725a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Converting VIF {"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:65,bridge_name='br-int',has_traffic_filtering=True,id=a3b3255e-5c2c-486a-975f-0769b0ad0d7c,network=Network(f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b3255e-5c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG os_vif [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:65,bridge_name='br-int',has_traffic_filtering=True,id=a3b3255e-5c2c-486a-975f-0769b0ad0d7c,network=Network(f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b3255e-5c') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6aaa6d8a-36fe-572d-a816-5b1a919a1ef7', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3b3255e-5c, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3b3255e-5c, col_values=(('qos', UUID('6841bdf5-8c03-484c-9d99-79c10186e014')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3b3255e-5c, col_values=(('external_ids', {'iface-id': 'a3b3255e-5c2c-486a-975f-0769b0ad0d7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:29:65', 'vm-uuid': '74d8883b-5873-42d1-ad25-6c8d80725a72'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:41 user nova-compute[76391]: INFO os_vif [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:65,bridge_name='br-int',has_traffic_filtering=True,id=a3b3255e-5c2c-486a-975f-0769b0ad0d7c,network=Network(f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b3255e-5c')
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:23:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] No VIF found with MAC fa:16:3e:05:29:65, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:23:42 user nova-compute[76391]: DEBUG nova.network.neutron [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Updated VIF entry in instance network info cache for port a3b3255e-5c2c-486a-975f-0769b0ad0d7c. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:23:42 user nova-compute[76391]: DEBUG nova.network.neutron [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Updating instance_info_cache with network_info: [{"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:23:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-da65d897-3f01-4f9d-81e6-8e2ff824085c req-f6c56c15-9566-4896-988e-e28ab77a3355 service nova] Releasing lock "refresh_cache-74d8883b-5873-42d1-ad25-6c8d80725a72" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-012a9037-f58b-4cf8-9d6f-59f75212d48f req-eb44fe7e-eb17-49d8-9451-63402cdb6993 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received event network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-012a9037-f58b-4cf8-9d6f-59f75212d48f req-eb44fe7e-eb17-49d8-9451-63402cdb6993 service nova] Acquiring lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-012a9037-f58b-4cf8-9d6f-59f75212d48f req-eb44fe7e-eb17-49d8-9451-63402cdb6993 service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-012a9037-f58b-4cf8-9d6f-59f75212d48f req-eb44fe7e-eb17-49d8-9451-63402cdb6993 service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-012a9037-f58b-4cf8-9d6f-59f75212d48f req-eb44fe7e-eb17-49d8-9451-63402cdb6993 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] No waiting events found dispatching network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:23:43 user nova-compute[76391]: WARNING nova.compute.manager [req-012a9037-f58b-4cf8-9d6f-59f75212d48f req-eb44fe7e-eb17-49d8-9451-63402cdb6993 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received unexpected event network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c for instance with vm_state building and task_state spawning.
Nov 15 23:23:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:23:45 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Instance spawned successfully.
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:23:45 user nova-compute[76391]: INFO nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:45 user nova-compute[76391]: INFO nova.compute.manager [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Took 6.39 seconds to build instance.
Nov 15 23:23:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c3f1e89a-01bc-4ad0-ac70-c89a18a9371d tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.488s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6fd87bbd-4daa-4602-94df-fcfbd1379c5f req-9aef56e9-6e21-4c46-8a6b-a2da29b72fe3 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received event network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6fd87bbd-4daa-4602-94df-fcfbd1379c5f req-9aef56e9-6e21-4c46-8a6b-a2da29b72fe3 service nova] Acquiring lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6fd87bbd-4daa-4602-94df-fcfbd1379c5f req-9aef56e9-6e21-4c46-8a6b-a2da29b72fe3 service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6fd87bbd-4daa-4602-94df-fcfbd1379c5f req-9aef56e9-6e21-4c46-8a6b-a2da29b72fe3 service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:23:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-6fd87bbd-4daa-4602-94df-fcfbd1379c5f req-9aef56e9-6e21-4c46-8a6b-a2da29b72fe3 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] No waiting events found dispatching network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:23:45 user nova-compute[76391]: WARNING nova.compute.manager [req-6fd87bbd-4daa-4602-94df-fcfbd1379c5f req-9aef56e9-6e21-4c46-8a6b-a2da29b72fe3 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received unexpected event network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c for instance with vm_state active and task_state None.
Nov 15 23:23:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:23:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:03 user nova-compute[76391]: INFO nova.compute.manager [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Detaching volume 952c4e5f-1fe6-473a-badf-44aff1c6ecc7
Nov 15 23:24:03 user nova-compute[76391]: INFO nova.virt.block_device [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Attempting to driver detach volume 952c4e5f-1fe6-473a-badf-44aff1c6ecc7 from mountpoint /dev/vdb
Nov 15 23:24:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Attempting to detach device vdb from instance e08c5f26-850b-4d4a-89ab-88f2066acc71 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:24:03 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:03 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:24:03 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:24:03 user nova-compute[76391]:   <serial>952c4e5f-1fe6-473a-badf-44aff1c6ecc7</serial>
Nov 15 23:24:03 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:24:03 user nova-compute[76391]: </disk>
Nov 15 23:24:03 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:24:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully detached device vdb from instance e08c5f26-850b-4d4a-89ab-88f2066acc71 from the persistent domain config.
Nov 15 23:24:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e08c5f26-850b-4d4a-89ab-88f2066acc71 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:24:03 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:03 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:24:03 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:24:03 user nova-compute[76391]:   <serial>952c4e5f-1fe6-473a-badf-44aff1c6ecc7</serial>
Nov 15 23:24:03 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:24:03 user nova-compute[76391]: </disk>
Nov 15 23:24:03 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG nova.objects.instance [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'flavor' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:04 user nova-compute[76391]: INFO nova.compute.manager [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Attaching volume 80718c96-06a2-4a85-abee-0bf416c1c891 to /dev/vdb
Nov 15 23:24:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG os_brick.utils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5375cd69-64c0-4d54-8ac0-3e54682dbc7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef762f1-b872-4bc4-89e8-3134ab0dc72a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3db9304-5ef7-4d3d-ad96-964cf056a7d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98e7a22-a1bd-41dc-a4e7-a0e279cdbbbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:04 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:24:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6b559-f655-47ec-9ae9-970b097b6ffa]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG os_brick.utils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:04 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating existing volume attachment record: c579d079-dbe7-4364-ae7a-92d1f8651d2f {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:24:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:06 user nova-compute[76391]: INFO nova.compute.manager [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Rescuing
Nov 15 23:24:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:06 user nova-compute[76391]: DEBUG nova.network.neutron [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:24:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG nova.network.neutron [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updating instance_info_cache with network_info: [{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ac86d83-915b-41dc-8f2a-1e60cebbf621 req-d3be95a7-b473-4499-9014-423795e0492f service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ac86d83-915b-41dc-8f2a-1e60cebbf621 req-d3be95a7-b473-4499-9014-423795e0492f service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ac86d83-915b-41dc-8f2a-1e60cebbf621 req-d3be95a7-b473-4499-9014-423795e0492f service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3ac86d83-915b-41dc-8f2a-1e60cebbf621 req-d3be95a7-b473-4499-9014-423795e0492f service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-3ac86d83-915b-41dc-8f2a-1e60cebbf621 req-d3be95a7-b473-4499-9014-423795e0492f service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:07 user nova-compute[76391]: WARNING nova.compute.manager [req-3ac86d83-915b-41dc-8f2a-1e60cebbf621 req-d3be95a7-b473-4499-9014-423795e0492f service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state active and task_state rescuing.
Nov 15 23:24:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance destroyed successfully.
Nov 15 23:24:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Attempting rescue
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:24:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Creating image(s)
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'trusted_certs' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue" returned: 0 in 0.054s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'migration_context' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.base [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<bfb44f27-ed01-4f78-a982-5302163e5069> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Start _get_guest_xml network_info=[{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:2b:dd:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'resources' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.base [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<bfb44f27-ed01-4f78-a982-5302163e5069> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'numa_topology' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.base [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<bfb44f27-ed01-4f78-a982-5302163e5069> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:08 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:08 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lazy-loading 'flavor' on Instance uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'vcpu_model' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.base [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<bfb44f27-ed01-4f78-a982-5302163e5069> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1775411528',display_name='tempest-ServerRescueNegativeTestJSON-server-1775411528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1775411528',id=17,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-xj9j2eo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:19:34Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=bfb44f27-ed01-4f78-a982-5302163e5069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:2b:dd:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:2b:dd:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'pci_devices' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.objects.base [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<bfb44f27-ed01-4f78-a982-5302163e5069> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:24:08 user nova-compute[76391]:   <uuid>bfb44f27-ed01-4f78-a982-5302163e5069</uuid>
Nov 15 23:24:08 user nova-compute[76391]:   <name>instance-00000011</name>
Nov 15 23:24:08 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:24:08 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:24:08 user nova-compute[76391]:   <metadata>
Nov 15 23:24:08 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:24:08 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:24:08 user nova-compute[76391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1775411528</nova:name>
Nov 15 23:24:08 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:24:08</nova:creationTime>
Nov 15 23:24:08 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:24:08 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:24:08 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:24:08 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:24:08 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:24:08 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:24:08 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:24:08 user nova-compute[76391]:       <nova:owner>
Nov 15 23:24:08 user nova-compute[76391]:         <nova:user uuid="3986dd9981e24a0f8faf441662255bab">tempest-ServerRescueNegativeTestJSON-1623431733-project-member</nova:user>
Nov 15 23:24:08 user nova-compute[76391]:         <nova:project uuid="3d522b2994d4474999b1a2d2d474c74b">tempest-ServerRescueNegativeTestJSON-1623431733</nova:project>
Nov 15 23:24:08 user nova-compute[76391]:       </nova:owner>
Nov 15 23:24:08 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:24:08 user nova-compute[76391]:       <nova:ports>
Nov 15 23:24:08 user nova-compute[76391]:         <nova:port uuid="914d7841-8a90-461e-83d6-efd74735dc0e">
Nov 15 23:24:08 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 23:24:08 user nova-compute[76391]:         </nova:port>
Nov 15 23:24:08 user nova-compute[76391]:       </nova:ports>
Nov 15 23:24:08 user nova-compute[76391]:     </nova:instance>
Nov 15 23:24:08 user nova-compute[76391]:   </metadata>
Nov 15 23:24:08 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:24:08 user nova-compute[76391]:     <system>
Nov 15 23:24:08 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:24:08 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:24:08 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:24:08 user nova-compute[76391]:       <entry name="serial">bfb44f27-ed01-4f78-a982-5302163e5069</entry>
Nov 15 23:24:08 user nova-compute[76391]:       <entry name="uuid">bfb44f27-ed01-4f78-a982-5302163e5069</entry>
Nov 15 23:24:08 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:24:08 user nova-compute[76391]:     </system>
Nov 15 23:24:08 user nova-compute[76391]:   </sysinfo>
Nov 15 23:24:08 user nova-compute[76391]:   <os>
Nov 15 23:24:08 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:24:08 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:24:08 user nova-compute[76391]:   </os>
Nov 15 23:24:08 user nova-compute[76391]:   <features>
Nov 15 23:24:08 user nova-compute[76391]:     <acpi/>
Nov 15 23:24:08 user nova-compute[76391]:     <apic/>
Nov 15 23:24:08 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:24:08 user nova-compute[76391]:   </features>
Nov 15 23:24:08 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:24:08 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:24:08 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:24:08 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:24:08 user nova-compute[76391]:   </clock>
Nov 15 23:24:08 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:24:08 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:24:08 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:24:08 user nova-compute[76391]:   </cpu>
Nov 15 23:24:08 user nova-compute[76391]:   <devices>
Nov 15 23:24:08 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:24:08 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:24:08 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue"/>
Nov 15 23:24:08 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:24:08 user nova-compute[76391]:     </disk>
Nov 15 23:24:08 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:24:08 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:24:08 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk"/>
Nov 15 23:24:08 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:24:08 user nova-compute[76391]:     </disk>
Nov 15 23:24:08 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:24:08 user nova-compute[76391]:       <mac address="fa:16:3e:2b:dd:a0"/>
Nov 15 23:24:08 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:08 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:24:08 user nova-compute[76391]:       <target dev="tap914d7841-8a"/>
Nov 15 23:24:08 user nova-compute[76391]:     </interface>
Nov 15 23:24:08 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:24:08 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/console.log" append="off"/>
Nov 15 23:24:08 user nova-compute[76391]:     </serial>
Nov 15 23:24:08 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:24:08 user nova-compute[76391]:     <video>
Nov 15 23:24:08 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:08 user nova-compute[76391]:     </video>
Nov 15 23:24:08 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:24:08 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:24:08 user nova-compute[76391]:     </rng>
Nov 15 23:24:08 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:24:08 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:24:08 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:24:08 user nova-compute[76391]:     </memballoon>
Nov 15 23:24:08 user nova-compute[76391]:   </devices>
Nov 15 23:24:08 user nova-compute[76391]: </domain>
Nov 15 23:24:08 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:24:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance destroyed successfully.
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No VIF found with MAC fa:16:3e:2b:dd:a0, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:08 user nova-compute[76391]: INFO nova.compute.manager [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Attaching volume 233f5b0c-3031-473f-b106-34585ff7c651 to /dev/vdb
Nov 15 23:24:08 user nova-compute[76391]: DEBUG os_brick.utils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f5aa1-9421-4406-8b49-f467e286b415]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cded628a-853d-4a42-a725-5a2b9f4cc18c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d0bd3-685c-417e-b82b-e32b24578652]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ae82ee-8ce7-46f1-854a-8ed3e77f17d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:08 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:24:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[95487d3c-6a5a-4a1f-89ee-5d23222ff20d]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG os_brick.utils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:08 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating existing volume attachment record: a8de363f-84af-4f64-9f32-b8cc1b3aa3aa {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsEpToHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:09 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0115a086-f268-4400-be68-ee8bef431bef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:24:09 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f5cea4-0743-49fa-bc8a-e6919ac8e357]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891] added
Nov 15 23:24:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[135cc61d-d73d-491b-8c81-3a513295e7cc]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8446b07b-b1a6-43c8-ba45-9ee9c9438fc4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsEpToHX {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsEpToHX" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f77eec-81ff-4a78-9b8e-297d8ab9e53c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WsEpToHX'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6beab87-5058-4308-a22e-f956f599c9da]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac365e-1598-4339-9642-6d74d72b316d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c71ed5-95fd-4763-b274-807df2a92a71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260]
Nov 15 23:24:09 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f00fe-192b-438a-ab8f-5fd61d775b26]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1610a50b-9fdb-42ac-8214-ac636b729d65]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:09 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c24b4-1d8d-4e80-9958-b211e4c17167]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsEpToHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b5af808-354e-4d1e-a5a4-1239b6a93043 req-f85c3cd4-069b-47f9-a722-198d0fd5b81c service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b5af808-354e-4d1e-a5a4-1239b6a93043 req-f85c3cd4-069b-47f9-a722-198d0fd5b81c service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b5af808-354e-4d1e-a5a4-1239b6a93043 req-f85c3cd4-069b-47f9-a722-198d0fd5b81c service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b5af808-354e-4d1e-a5a4-1239b6a93043 req-f85c3cd4-069b-47f9-a722-198d0fd5b81c service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b5af808-354e-4d1e-a5a4-1239b6a93043 req-f85c3cd4-069b-47f9-a722-198d0fd5b81c service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:09 user nova-compute[76391]: WARNING nova.compute.manager [req-9b5af808-354e-4d1e-a5a4-1239b6a93043 req-f85c3cd4-069b-47f9-a722-198d0fd5b81c service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state active and task_state rescuing.
Nov 15 23:24:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23933346464376336', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933346464376336', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG nova.objects.instance [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'flavor' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:24:10 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:10 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:24:10 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:24:10 user nova-compute[76391]:   <serial>80718c96-06a2-4a85-abee-0bf416c1c891</serial>
Nov 15 23:24:10 user nova-compute[76391]: </disk>
Nov 15 23:24:10 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No VIF found with MAC fa:16:3e:c9:73:56, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dc1f518e-349f-485b-a2ea-6ec381ab767a tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.147s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:11 user nova-compute[76391]: WARNING nova.compute.manager [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state active and task_state rescuing.
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:11 user nova-compute[76391]: WARNING nova.compute.manager [req-355d0665-0f9d-4475-a0fb-061904d9d51f req-cc0334bb-ef2f-48d5-b384-130626ba58ec service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state active and task_state rescuing.
Nov 15 23:24:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:11 user nova-compute[76391]: INFO nova.compute.manager [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Rescuing
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquired lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:24:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-85f8275d-feae-4aff-ae9d-7d19b9d81335 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:24:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Releasing lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance destroyed successfully.
Nov 15 23:24:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Attempting a stable device rescue
Nov 15 23:24:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=76391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 23:24:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:24:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Creating image(s)
Nov 15 23:24:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "0d1278e39a10fb0e3fd52a64791825bf6c61235b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "0d1278e39a10fb0e3fd52a64791825bf6c61235b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:14 user nova-compute[76391]: WARNING nova.compute.manager [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state active and task_state rescuing.
Nov 15 23:24:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:14 user nova-compute[76391]: WARNING nova.compute.manager [req-179b329e-ad30-4c6c-9257-31a4a6ecf769 req-87e2e84c-8d2e-4079-9d86-a6279c75d082 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state active and task_state rescuing.
Nov 15 23:24:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:14 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:14 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:14 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15520cdf-a2b4-467a-b5b2-de4d72e6d844]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:24:14 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a284ca6d-912f-4303-b955-3a67f54de02c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651] added
Nov 15 23:24:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f547a-1d2e-49f2-b290-516cb5beb7c4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2f752f-b51a-4892-b90c-a17d4f2ca96f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THVEqGil {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.part --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG nova.virt.images [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] 987e6931-fc84-4f96-b0a8-d5cc4cc94df6 was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.part /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THVEqGil" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6081cec-2a92-404f-bd7e-34e5269b3e68]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THVEqGil'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b1df3-006a-45e9-b095-dc1f799378ae]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[194696c1-3a13-4250-a4c9-a27769e9d1a6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --login" returned: 0 in 0.188s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0016ebe8-f51a-40ec-a47a-8fab2eaa3e45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]
Nov 15 23:24:14 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e992dcb9-597e-41d0-8447-077bb11b94f4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe1608-65bf-4536-840c-229ebf7da4fd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.048s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf553a-5738-414d-bace-c00fe3e25708]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:24:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.part /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.converted" returned: 0 in 0.521s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "0d1278e39a10fb0e3fd52a64791825bf6c61235b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.929s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "0d1278e39a10fb0e3fd52a64791825bf6c61235b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "0d1278e39a10fb0e3fd52a64791825bf6c61235b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b,backing_fmt=raw /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b,backing_fmt=raw /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue" returned: 0 in 0.054s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "0d1278e39a10fb0e3fd52a64791825bf6c61235b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'migration_context' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Object Instance<53814dee-eafa-4742-9888-2bfcafa5ee91> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Start _get_guest_xml network_info=[{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "vif_mac": "fa:16:3e:c9:73:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '987e6931-fc84-4f96-b0a8-d5cc4cc94df6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsEpToHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '53814dee-eafa-4742-9888-2bfcafa5ee91', 'attached_at': '', 'detached_at': '', 'volume_id': '80718c96-06a2-4a85-abee-0bf416c1c891', 'serial': '80718c96-06a2-4a85-abee-0bf416c1c891'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': 'c579d079-dbe7-4364-ae7a-92d1f8651d2f', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'resources' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Object Instance<53814dee-eafa-4742-9888-2bfcafa5ee91> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'numa_topology' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Object Instance<53814dee-eafa-4742-9888-2bfcafa5ee91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:15 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:15 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Object Instance<53814dee-eafa-4742-9888-2bfcafa5ee91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsEpToHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:15 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '26633376462613135', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633376462613135', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.273s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:15 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:15 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lazy-loading 'flavor' on Instance uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d1c4fc-7257-424a-97c6-21fddee7c862]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WsEpToHX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 23:24:15 user nova-compute[76391]: node.name = iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:24:15 user nova-compute[76391]: node.tpgt = -1
Nov 15 23:24:15 user nova-compute[76391]: node.startup = automatic
Nov 15 23:24:15 user nova-compute[76391]: node.leading_login = No
Nov 15 23:24:15 user nova-compute[76391]: iface.iscsi_ifacename = default
Nov 15 23:24:15 user nova-compute[76391]: iface.net_ifacename = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.ipaddress = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.prefix_len = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.hwaddress = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.transport_name = tcp
Nov 15 23:24:15 user nova-compute[76391]: iface.initiatorname = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.state = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.vlan_id = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.vlan_priority = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.vlan_state = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.iface_num = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.mtu = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.port = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.bootproto = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.subnet_mask = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.gateway = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_alt_client_id = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_dns = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_learn_iqn = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_vendor_id_state = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_vendor_id = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.dhcp_slp_da = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.fragmentation = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.gratuitous_arp = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.incoming_forwarding = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.tos_state = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.tos = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.ttl = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.delayed_ack = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.tcp_nagle = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.tcp_wsf_state = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.tcp_wsf = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.tcp_timer_scale = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.tcp_timestamp = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.redirect = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.def_task_mgmt_timeout = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.header_digest = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.data_digest = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.immediate_data = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.initial_r2t = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.data_seq_inorder = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.data_pdu_inorder = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.erl = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.max_receive_data_len = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.first_burst_len = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.max_outstanding_r2t = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.max_burst_len = 0
Nov 15 23:24:15 user nova-compute[76391]: iface.chap_auth = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.bidi_chap = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.strict_login_compliance = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.discovery_auth = <empty>
Nov 15 23:24:15 user nova-compute[76391]: iface.discovery_logout = <empty>
Nov 15 23:24:15 user nova-compute[76391]: node.discovery_address = <empty>
Nov 15 23:24:15 user nova-compute[76391]: node.discovery_port = 0
Nov 15 23:24:15 user nova-compute[76391]: node.discovery_type = static
Nov 15 23:24:15 user nova-compute[76391]: node.session.initial_cmdsn = 0
Nov 15 23:24:15 user nova-compute[76391]: node.session.initial_login_retry_max = 8
Nov 15 23:24:15 user nova-compute[76391]: node.session.xmit_thread_priority = -20
Nov 15 23:24:15 user nova-compute[76391]: node.session.cmds_max = 128
Nov 15 23:24:15 user nova-compute[76391]: node.session.queue_depth = 32
Nov 15 23:24:15 user nova-compute[76391]: node.session.nr_sessions = 1
Nov 15 23:24:15 user nova-compute[76391]: node.session.auth.authmethod = CHAP
Nov 15 23:24:15 user nova-compute[76391]: node.session.auth.username = WsEpToHX
Nov 15 23:24:15 user nova-compute[76391]: node.session.auth.password = ***
Nov 15 23:24:15 user nova-compute[76391]: node.session.auth.username_in = <empty>
Nov 15 23:24:15 user nova-compute[76391]: node.session.auth.password_in = <empty>
Nov 15 23:24:15 user nova-compute[76391]: node.session.auth.chap_algs = MD5
Nov 15 23:24:15 user nova-compute[76391]: node.session.timeo.replacement_timeout = 120
Nov 15 23:24:15 user nova-compute[76391]: node.session.err_timeo.abort_timeout = 15
Nov 15 23:24:15 user nova-compute[76391]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 23:24:15 user nova-compute[76391]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 23:24:15 user nova-compute[76391]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.FastAbort = Yes
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.InitialR2T = No
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.ImmediateData = Yes
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.MaxConnections = 1
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 23:24:15 user nova-compute[76391]: node.session.iscsi.ERL = 0
Nov 15 23:24:15 user nova-compute[76391]: node.session.scan = manual
Nov 15 23:24:15 user nova-compute[76391]: node.session.reopen_max = 0
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].address = 172.16.0.220
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].port = 3260
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].startup = manual
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].tcp.window_size = 524288
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].tcp.type_of_service = 0
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].timeo.logout_timeout = 15
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].timeo.login_timeout = 15
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].timeo.auth_timeout = 45
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].iscsi.DataDigest = None
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].iscsi.IFMarker = No
Nov 15 23:24:15 user nova-compute[76391]: node.conn[0].iscsi.OFMarker = No
Nov 15 23:24:15 user nova-compute[76391]: # END RECORD
Nov 15 23:24:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:24:15 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:15 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:24:15 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:24:15 user nova-compute[76391]:   <serial>233f5b0c-3031-473f-b106-34585ff7c651</serial>
Nov 15 23:24:15 user nova-compute[76391]: </disk>
Nov 15 23:24:15 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[475239e4-d10a-4e11-8eea-b55db8631b9c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3866e8-c77d-4def-95d7-214667fb0a71]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsEpToHX {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updating instance_info_cache with network_info: [{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsEpToHX" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af8fec-26f6-43a9-a99d-023ece4859f7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WsEpToHX'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17f388d-5ba1-4a68-8116-3a2b1aec2bfd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6f264-4ab1-47bc-bbe2-84f892d3d93e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:16 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:16 user nova-compute[76391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:16 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.183s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] HCTL ('36', '0', '0', 0) found on session 25 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d0214b-3cf0-43b1-b726-bb82390e599d]: (4, ('0 0 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Searching for a device in session 25 and hctl ('36', '0', '0', 0) yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsEpToHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] <== connect_volume: return (485ms) {'type': 'block', 'scsi_wwn': '23933346464376336', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933346464376336', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-408591733',display_name='tempest-ServerStableDeviceRescueTest-server-408591733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-408591733',id=21,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJqUpSw/TXkHYm7b4bi08C4AfmdJoxvyVGSic+nhrsDXAssxcuasdq+Orfi/R/2gDVO9en5VTOxxybZiTZ8R5ELr9EXaWXDSiGrH03qbtjWWkRDaJhwFhf0qHbJeiSf8A==',key_name='tempest-keypair-729520390',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55551c07142e448bb6111c0c35fb3ee0',ramdisk_id='',reservation_id='r-m52hfv3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-802850774',owner_user_name='tempest-ServerStableDeviceRescueTest-802850774-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:22:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8130ccbe83bf4c5cbc4698cd64b0007a',uuid=53814dee-eafa-4742-9888-2bfcafa5ee91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "vif_mac": "fa:16:3e:c9:73:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converting VIF {"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "vif_mac": "fa:16:3e:c9:73:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'pci_devices' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.objects.base [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Object Instance<53814dee-eafa-4742-9888-2bfcafa5ee91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:24:16 user nova-compute[76391]:   <uuid>53814dee-eafa-4742-9888-2bfcafa5ee91</uuid>
Nov 15 23:24:16 user nova-compute[76391]:   <name>instance-00000015</name>
Nov 15 23:24:16 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:24:16 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:24:16 user nova-compute[76391]:   <metadata>
Nov 15 23:24:16 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:24:16 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:24:16 user nova-compute[76391]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-408591733</nova:name>
Nov 15 23:24:16 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:24:15</nova:creationTime>
Nov 15 23:24:16 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:24:16 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:24:16 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:24:16 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:24:16 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:24:16 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:24:16 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:24:16 user nova-compute[76391]:       <nova:owner>
Nov 15 23:24:16 user nova-compute[76391]:         <nova:user uuid="8130ccbe83bf4c5cbc4698cd64b0007a">tempest-ServerStableDeviceRescueTest-802850774-project-member</nova:user>
Nov 15 23:24:16 user nova-compute[76391]:         <nova:project uuid="55551c07142e448bb6111c0c35fb3ee0">tempest-ServerStableDeviceRescueTest-802850774</nova:project>
Nov 15 23:24:16 user nova-compute[76391]:       </nova:owner>
Nov 15 23:24:16 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:24:16 user nova-compute[76391]:       <nova:ports>
Nov 15 23:24:16 user nova-compute[76391]:         <nova:port uuid="15463d4f-33b1-488b-85a6-ba2d5c15c10b">
Nov 15 23:24:16 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 23:24:16 user nova-compute[76391]:         </nova:port>
Nov 15 23:24:16 user nova-compute[76391]:       </nova:ports>
Nov 15 23:24:16 user nova-compute[76391]:     </nova:instance>
Nov 15 23:24:16 user nova-compute[76391]:   </metadata>
Nov 15 23:24:16 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:24:16 user nova-compute[76391]:     <system>
Nov 15 23:24:16 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:24:16 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:24:16 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:24:16 user nova-compute[76391]:       <entry name="serial">53814dee-eafa-4742-9888-2bfcafa5ee91</entry>
Nov 15 23:24:16 user nova-compute[76391]:       <entry name="uuid">53814dee-eafa-4742-9888-2bfcafa5ee91</entry>
Nov 15 23:24:16 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:24:16 user nova-compute[76391]:     </system>
Nov 15 23:24:16 user nova-compute[76391]:   </sysinfo>
Nov 15 23:24:16 user nova-compute[76391]:   <os>
Nov 15 23:24:16 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:24:16 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:24:16 user nova-compute[76391]:   </os>
Nov 15 23:24:16 user nova-compute[76391]:   <features>
Nov 15 23:24:16 user nova-compute[76391]:     <acpi/>
Nov 15 23:24:16 user nova-compute[76391]:     <apic/>
Nov 15 23:24:16 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:24:16 user nova-compute[76391]:   </features>
Nov 15 23:24:16 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:24:16 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:24:16 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:24:16 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:24:16 user nova-compute[76391]:   </clock>
Nov 15 23:24:16 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:24:16 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:24:16 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:24:16 user nova-compute[76391]:   </cpu>
Nov 15 23:24:16 user nova-compute[76391]:   <devices>
Nov 15 23:24:16 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:24:16 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:24:16 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk"/>
Nov 15 23:24:16 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:24:16 user nova-compute[76391]:     </disk>
Nov 15 23:24:16 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:24:16 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:16 user nova-compute[76391]:       <source dev="/dev/sde"/>
Nov 15 23:24:16 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:24:16 user nova-compute[76391]:       <serial>80718c96-06a2-4a85-abee-0bf416c1c891</serial>
Nov 15 23:24:16 user nova-compute[76391]:     </disk>
Nov 15 23:24:16 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:24:16 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:24:16 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue"/>
Nov 15 23:24:16 user nova-compute[76391]:       <target dev="vdc" bus="virtio"/>
Nov 15 23:24:16 user nova-compute[76391]:       <boot order="1"/>
Nov 15 23:24:16 user nova-compute[76391]:     </disk>
Nov 15 23:24:16 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:24:16 user nova-compute[76391]:       <mac address="fa:16:3e:c9:73:56"/>
Nov 15 23:24:16 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:16 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:24:16 user nova-compute[76391]:       <target dev="tap15463d4f-33"/>
Nov 15 23:24:16 user nova-compute[76391]:     </interface>
Nov 15 23:24:16 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:24:16 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/console.log" append="off"/>
Nov 15 23:24:16 user nova-compute[76391]:     </serial>
Nov 15 23:24:16 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:24:16 user nova-compute[76391]:     <video>
Nov 15 23:24:16 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:16 user nova-compute[76391]:     </video>
Nov 15 23:24:16 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:24:16 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:24:16 user nova-compute[76391]:     </rng>
Nov 15 23:24:16 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:24:16 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:24:16 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:24:16 user nova-compute[76391]:     </memballoon>
Nov 15 23:24:16 user nova-compute[76391]:   </devices>
Nov 15 23:24:16 user nova-compute[76391]: </domain>
Nov 15 23:24:16 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:24:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance destroyed successfully.
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] No VIF found with MAC fa:16:3e:c9:73:56, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No VIF found with MAC fa:16:3e:0c:74:2a, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-edca57f3-6690-4470-ae98-b600ab0f0e8b tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.976s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG nova.objects.instance [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'flavor' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:17 user nova-compute[76391]: INFO nova.compute.manager [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Attaching volume cbe2f0c5-a2b0-4290-a376-15d59467518f to /dev/vdb
Nov 15 23:24:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG os_brick.utils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad1709-7da1-45bd-b985-59a1a7c08977]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[741d52ab-06fa-4d15-83e7-0a88b70851bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4514ee85-c2e4-4f2b-9ed6-8567cac47356]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[489f5603-00fc-46e8-b1bb-5fa8ce83df66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:18 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[651e9ab4-f4a2-4052-a7fc-d0aa758f1ed3]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG os_brick.utils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating existing volume attachment record: 91d541fc-ad9e-4b5c-9b41-fcb66979c47f {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-ba4a375a-f4b6-4a3d-96e5-746c09a54daa req-d140a7f0-3f22-4790-9995-f4f3449fe7f1 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ba4a375a-f4b6-4a3d-96e5-746c09a54daa req-d140a7f0-3f22-4790-9995-f4f3449fe7f1 service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ba4a375a-f4b6-4a3d-96e5-746c09a54daa req-d140a7f0-3f22-4790-9995-f4f3449fe7f1 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ba4a375a-f4b6-4a3d-96e5-746c09a54daa req-d140a7f0-3f22-4790-9995-f4f3449fe7f1 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-ba4a375a-f4b6-4a3d-96e5-746c09a54daa req-d140a7f0-3f22-4790-9995-f4f3449fe7f1 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:18 user nova-compute[76391]: WARNING nova.compute.manager [req-ba4a375a-f4b6-4a3d-96e5-746c09a54daa req-d140a7f0-3f22-4790-9995-f4f3449fe7f1 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state active and task_state rescuing.
Nov 15 23:24:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Stashing vm_state: active {{(pid=76391) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 23:24:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:19 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:24:19 user nova-compute[76391]: INFO nova.compute.claims [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Claim successful on node user
Nov 15 23:24:19 user nova-compute[76391]: INFO nova.compute.resource_tracker [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating resource usage from migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-ed545a32-107b-4682-b2b2-fd93d4b6bb4f req-cf70e9e7-2f8b-4c63-82d1-08df6b1d69b6 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ed545a32-107b-4682-b2b2-fd93d4b6bb4f req-cf70e9e7-2f8b-4c63-82d1-08df6b1d69b6 service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ed545a32-107b-4682-b2b2-fd93d4b6bb4f req-cf70e9e7-2f8b-4c63-82d1-08df6b1d69b6 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ed545a32-107b-4682-b2b2-fd93d4b6bb4f req-cf70e9e7-2f8b-4c63-82d1-08df6b1d69b6 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-ed545a32-107b-4682-b2b2-fd93d4b6bb4f req-cf70e9e7-2f8b-4c63-82d1-08df6b1d69b6 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:20 user nova-compute[76391]: WARNING nova.compute.manager [req-ed545a32-107b-4682-b2b2-fd93d4b6bb4f req-cf70e9e7-2f8b-4c63-82d1-08df6b1d69b6 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state active and task_state rescuing.
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.540s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:20 user nova-compute[76391]: INFO nova.compute.manager [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Migrating
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquired lock "compute-rpcapi-router" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:20 user nova-compute[76391]: INFO nova.compute.rpcapi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Releasing lock "compute-rpcapi-router" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquired lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fc3643ea-0bcc-4b97-a093-1ce937f1e01b tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Releasing lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Starting migrate_disk_and_power_off {{(pid=76391) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:21 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance destroyed successfully.
Nov 15 23:24:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047332978-network", "vif_mac": "fa:16:3e:0c:74:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047332978-network", "vif_mac": "fa:16:3e:0c:74:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG os_vif [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6e3d304-aa, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa9b9d9d-0c20-463c-8e58-9872aa46f650) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:21 user nova-compute[76391]: INFO os_vif [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa')
Nov 15 23:24:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:21 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dc1b59-1a24-4968-ae57-0392ad36618a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:24:21 user nova-compute[76391]: No targets found.
Nov 15 23:24:21 user nova-compute[76391]: iSNS:
Nov 15 23:24:21 user nova-compute[76391]: No targets found.
Nov 15 23:24:21 user nova-compute[76391]: STATIC:
Nov 15 23:24:21 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7
Nov 15 23:24:21 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:21 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:21 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d
Nov 15 23:24:21 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:21 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:21 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:24:21 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:21 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:21 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:24:21 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:21 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:21 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:24:21 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:21 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:21 user nova-compute[76391]: FIRMWARE:
Nov 15 23:24:21 user nova-compute[76391]: No targets found.
Nov 15 23:24:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:24:22 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:24:22 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[250ab0ce-25a8-40ed-9996-e7d7b0476fd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e110104a-f567-4419-8da8-3f69608ea8f3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:22 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:22 user nova-compute[76391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:22 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f974036ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9926f22e-723f-4a69-a123-820deeecb759]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588bf93-966a-4fd8-afd5-55d382cd2924]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd38a7ca-8fcb-42dc-b713-65e4da74304c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca2f53d-ca18-49c4-9a22-a4416a62f8c6]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:22 user nova-compute[76391]: WARNING nova.compute.manager [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state active and task_state resize_migrating.
Nov 15 23:24:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:22 user nova-compute[76391]: WARNING nova.compute.manager [req-fa8c3188-4c41-4208-9e47-a7de64b0a820 req-2fd38a5b-dca8-4064-ab1d-64c84c522c6e service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state active and task_state resize_migrating.
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e05a68a-4c00-461f-a1c0-3c81bb848980]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[918242bc-e700-4ebf-994c-da9fc34e4729]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]
Nov 15 23:24:22 user nova-compute[76391]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:22 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ced64fe-3071-474a-9952-441f4bb60dcb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== disconnect_volume: return (397ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f_resize/disk /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "cp -r /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f_resize/disk /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk" returned: 0 in 0.371s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f_resize/disk.info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk.info {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "cp -r /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f_resize/disk.info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk.info" returned: 0 in 0.038s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPcyNEax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:23 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:23 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:23 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd59a5d7-659f-48ed-9319-c3115f288cf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:24:23 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0f4bd0-185a-4bf1-88c4-1baa17e0c5e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f] added
Nov 15 23:24:23 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b06cb51-8f10-47be-b055-f8a3f6a3b9a5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05f3838-8460-4dcb-8ff5-5266eeaee777]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPcyNEax {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPcyNEax" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8305c2-215d-40cb-a91f-467fae68930b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPcyNEax'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1d8ff3-f75a-4294-b9f2-708c2fc1c4a8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c8850-d8c4-4bf9-a5c1-030cc0d11e96]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:23 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:23 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:23 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:23 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:23 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:23 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:23 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:23 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e89004-5335-42ab-89db-f2b89154a694]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]
Nov 15 23:24:23 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:23 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2044fa-dcda-486d-9b2d-ee22f75823fc]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d2388-77fe-4494-b8c5-a7c48713b2ea]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:24 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:24 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:24 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:24 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e08c5f26-850b-4d4a-89ab-88f2066acc71 is timed out.
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a129a8-b586-4b7a-a33a-59dabc0842d1]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPcyNEax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:24:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully detached device vdb from instance e08c5f26-850b-4d4a-89ab-88f2066acc71 from the live domain config.
Nov 15 23:24:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbUlykrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:24 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Port f6e3d304-aa96-4149-9ea5-9fb21f718c1c binding to destination host user is already ACTIVE {{(pid=76391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquired lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26332313430633064', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332313430633064', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.010s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.objects.instance [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'flavor' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac95fc-684d-4274-9702-6c7c47546a8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:24:25 user nova-compute[76391]: No targets found.
Nov 15 23:24:25 user nova-compute[76391]: iSNS:
Nov 15 23:24:25 user nova-compute[76391]: No targets found.
Nov 15 23:24:25 user nova-compute[76391]: STATIC:
Nov 15 23:24:25 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f
Nov 15 23:24:25 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:25 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:25 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7
Nov 15 23:24:25 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:25 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:25 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d
Nov 15 23:24:25 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:25 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:25 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:24:25 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:25 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:25 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:24:25 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:25 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:25 user nova-compute[76391]: FIRMWARE:
Nov 15 23:24:25 user nova-compute[76391]: No targets found.
Nov 15 23:24:25 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:24:25 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:24:25 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:24:25 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:25 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:24:25 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:24:25 user nova-compute[76391]:   <serial>cbe2f0c5-a2b0-4290-a376-15d59467518f</serial>
Nov 15 23:24:25 user nova-compute[76391]: </disk>
Nov 15 23:24:25 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e565fca-5a53-468d-974d-cc2f9cbd804a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff9bfc-bb8d-4b82-85c7-bbcaa9944994]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:25 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:25 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:25 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740352f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7'): ({'sdd'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Removing single pathed devices sdd {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d057d1-5a5a-4246-a91b-04e15f3e9c2a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41144c1-67e6-445e-9317-08f36e68ad34]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flushing IO for device /dev/sdd {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a36e69-597f-4dd3-bb70-4580e5526a63]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[107257ec-3535-464d-94b3-ab2e34f448e3]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b77b7-5ade-4bd9-b82b-563a0cbff58b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Releasing lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb292b1-63ed-468d-a7ab-cb8cb10f9ea0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260]
Nov 15 23:24:25 user nova-compute[76391]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:25 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c4e5f-1fe6-473a-badf-44aff1c6ecc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8494c29-5a49-45b4-8880-5b9d506d56c5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== disconnect_volume: return (1420ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.utils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f8f9a-663c-4c23-b513-22601709584c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd05db-aa2a-4314-adb1-66f4d20313ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b558b6f3-9715-4918-83bc-f814707037f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[603bcd21-8d6c-4d81-82e5-298a84f8709f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:24:25 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[612b6553-ebcb-4407-b9a7-f217cb7aa474]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG os_brick.utils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No VIF found with MAC fa:16:3e:c0:90:2f, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa71ba85-fb37-4573-89fa-61a1c1e6e32e tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.194s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'flavor' on Instance uuid e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7a1384f-c377-4f4c-9ee9-6273ed18c723 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.949s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-changed-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Refreshing instance network info cache due to event network-changed-8acb3576-ff3c-4297-9fd7-ee981710af13. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] Acquiring lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] Acquired lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG nova.network.neutron [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Refreshing network info cache for port 8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updated VIF entry in instance network info cache for port 8acb3576-ff3c-4297-9fd7-ee981710af13. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6992MB free_disk=24.89775848388672GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea3668c0-3c19-4817-bd50-700f00ac4d6e req-8f5458f5-d7eb-4293-af4e-9d2be37aa0ea service nova] Releasing lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Applying migration context for instance 39b01e2d-c7e1-4fb0-a184-088120332b4f as it has an incoming, in-progress migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1. Migration status is post-migrating {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 23:24:27 user nova-compute[76391]: INFO nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating resource usage from migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e08c5f26-850b-4d4a-89ab-88f2066acc71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance c28f3f3d-8148-4c30-8070-9acff631ab32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance c321a8f4-8732-4ba1-afb2-e17ca757794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 74d8883b-5873-42d1-ad25-6c8d80725a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:24:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:24:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:24:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:24:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:24:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:24:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing instance network info cache due to event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] Acquiring lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] Acquired lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG nova.network.neutron [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Starting finish_migration {{(pid=76391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:24:31 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Creating image(s)
Nov 15 23:24:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk. size=21474836480 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.network.neutron [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updated VIF entry in instance network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.network.neutron [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:32 user nova-compute[76391]: INFO nova.compute.manager [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Shelving
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8d29826b-21db-4d41-9a83-8c73b01a3855 req-8da699ac-1b2f-4703-96d4-5e3a8a1f008f service nova] Releasing lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk 21474836480 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk 21474836480" returned: 0 in 0.351s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Ensure instance console log exists: /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Start _get_guest_xml network_info=[{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047332978-network", "vif_mac": "fa:16:3e:0c:74:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '39b01e2d-c7e1-4fb0-a184-088120332b4f', 'attached_at': '2023-11-15T23:24:32.000000', 'detached_at': '', 'volume_id': '233f5b0c-3031-473f-b106-34585ff7c651', 'serial': '233f5b0c-3031-473f-b106-34585ff7c651'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '0126069e-5864-47ae-96d4-0d9d45e096e3', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:24:32 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:32 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:32 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:32 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:32 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3032f220-0b3c-4726-8c75-1243e6e04f27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:24:32 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc7d6e5-89bb-4bc1-b273-c182930c14c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651] added
Nov 15 23:24:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e325544e-8d2b-4878-a364-ca73cd6d8a7f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336ad94-fe77-45c4-b448-09938edebc6f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THVEqGil {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THVEqGil" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594a7b0-e83e-4daf-b6d3-ac10e69c374f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THVEqGil'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4b295b-483a-4ebc-b298-03c61bc711b3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84325df-cbb7-460e-9b9f-a86e4ca7ea25]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:32 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:32 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:32 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:32 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:32 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:32 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance destroyed successfully.
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23bae9-e07c-425b-a6be-c9eb72b543e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]
Nov 15 23:24:32 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e76c3d-ef4c-489d-822f-16f1f8f7305a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:33 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Beginning cold snapshot process
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8ceca3-afd8-49bc-a111-41851f011dbc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:33 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a4d20-3a9d-49c0-84b3-87e84834bf28]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk /opt/stack/data/nova/instances/snapshots/tmp7hjfzjq7/1f727927a81e4ce1a2706623d51bd445 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-unplugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-unplugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:33 user nova-compute[76391]: WARNING nova.compute.manager [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received unexpected event network-vif-unplugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 15 23:24:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:33 user nova-compute[76391]: WARNING nova.compute.manager [req-ef0fc838-f374-48f5-844c-2144727f957f req-608296b2-7b4a-42b9-b2e4-2f9207d67b5f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received unexpected event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 15 23:24:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk /opt/stack/data/nova/instances/snapshots/tmp7hjfzjq7/1f727927a81e4ce1a2706623d51bd445" returned: 0 in 0.739s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:33 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Snapshot extracted, beginning image upload
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-changed-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Refreshing instance network info cache due to event network-changed-3f8a3ffc-04a1-4462-8421-1258e8e489bf. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] Acquiring lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] Acquired lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Refreshing network info cache for port 3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26633376462613135', 'path': '/dev/sdd'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633376462613135', 'path': '/dev/sdd'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:24:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047332978-network", "vif_mac": "fa:16:3e:0c:74:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047332978-network", "vif_mac": "fa:16:3e:0c:74:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:24:34 user nova-compute[76391]:   <uuid>39b01e2d-c7e1-4fb0-a184-088120332b4f</uuid>
Nov 15 23:24:34 user nova-compute[76391]:   <name>instance-00000016</name>
Nov 15 23:24:34 user nova-compute[76391]:   <memory>2097152</memory>
Nov 15 23:24:34 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:24:34 user nova-compute[76391]:   <metadata>
Nov 15 23:24:34 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:24:34 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:24:34 user nova-compute[76391]:       <nova:name>tempest-ServerActionsTestOtherB-server-1479706453</nova:name>
Nov 15 23:24:34 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:24:32</nova:creationTime>
Nov 15 23:24:34 user nova-compute[76391]:       <nova:flavor name="m1.small">
Nov 15 23:24:34 user nova-compute[76391]:         <nova:memory>2048</nova:memory>
Nov 15 23:24:34 user nova-compute[76391]:         <nova:disk>20</nova:disk>
Nov 15 23:24:34 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:24:34 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:24:34 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:24:34 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:24:34 user nova-compute[76391]:       <nova:owner>
Nov 15 23:24:34 user nova-compute[76391]:         <nova:user uuid="a246bfc3bf184459b37f06965c15b77b">tempest-ServerActionsTestOtherB-518662408-project-member</nova:user>
Nov 15 23:24:34 user nova-compute[76391]:         <nova:project uuid="e3ad6f3dde3a4b8b9a78f79cebabd970">tempest-ServerActionsTestOtherB-518662408</nova:project>
Nov 15 23:24:34 user nova-compute[76391]:       </nova:owner>
Nov 15 23:24:34 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:24:34 user nova-compute[76391]:       <nova:ports>
Nov 15 23:24:34 user nova-compute[76391]:         <nova:port uuid="f6e3d304-aa96-4149-9ea5-9fb21f718c1c">
Nov 15 23:24:34 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:24:34 user nova-compute[76391]:         </nova:port>
Nov 15 23:24:34 user nova-compute[76391]:       </nova:ports>
Nov 15 23:24:34 user nova-compute[76391]:     </nova:instance>
Nov 15 23:24:34 user nova-compute[76391]:   </metadata>
Nov 15 23:24:34 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:24:34 user nova-compute[76391]:     <system>
Nov 15 23:24:34 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:24:34 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:24:34 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:24:34 user nova-compute[76391]:       <entry name="serial">39b01e2d-c7e1-4fb0-a184-088120332b4f</entry>
Nov 15 23:24:34 user nova-compute[76391]:       <entry name="uuid">39b01e2d-c7e1-4fb0-a184-088120332b4f</entry>
Nov 15 23:24:34 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:24:34 user nova-compute[76391]:     </system>
Nov 15 23:24:34 user nova-compute[76391]:   </sysinfo>
Nov 15 23:24:34 user nova-compute[76391]:   <os>
Nov 15 23:24:34 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:24:34 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:24:34 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:24:34 user nova-compute[76391]:   </os>
Nov 15 23:24:34 user nova-compute[76391]:   <features>
Nov 15 23:24:34 user nova-compute[76391]:     <acpi/>
Nov 15 23:24:34 user nova-compute[76391]:     <apic/>
Nov 15 23:24:34 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:24:34 user nova-compute[76391]:   </features>
Nov 15 23:24:34 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:24:34 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:24:34 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:24:34 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:24:34 user nova-compute[76391]:   </clock>
Nov 15 23:24:34 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:24:34 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:24:34 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:24:34 user nova-compute[76391]:   </cpu>
Nov 15 23:24:34 user nova-compute[76391]:   <devices>
Nov 15 23:24:34 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:24:34 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:24:34 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk"/>
Nov 15 23:24:34 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:24:34 user nova-compute[76391]:     </disk>
Nov 15 23:24:34 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:24:34 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:34 user nova-compute[76391]:       <source dev="/dev/sdd"/>
Nov 15 23:24:34 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:24:34 user nova-compute[76391]:       <serial>233f5b0c-3031-473f-b106-34585ff7c651</serial>
Nov 15 23:24:34 user nova-compute[76391]:     </disk>
Nov 15 23:24:34 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:24:34 user nova-compute[76391]:       <mac address="fa:16:3e:0c:74:2a"/>
Nov 15 23:24:34 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:34 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:24:34 user nova-compute[76391]:       <target dev="tapf6e3d304-aa"/>
Nov 15 23:24:34 user nova-compute[76391]:     </interface>
Nov 15 23:24:34 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:24:34 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/console.log" append="off"/>
Nov 15 23:24:34 user nova-compute[76391]:     </serial>
Nov 15 23:24:34 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:24:34 user nova-compute[76391]:     <video>
Nov 15 23:24:34 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:34 user nova-compute[76391]:     </video>
Nov 15 23:24:34 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:24:34 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:24:34 user nova-compute[76391]:     </rng>
Nov 15 23:24:34 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:24:34 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:24:34 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:24:34 user nova-compute[76391]:     </memballoon>
Nov 15 23:24:34 user nova-compute[76391]:   </devices>
Nov 15 23:24:34 user nova-compute[76391]: </domain>
Nov 15 23:24:34 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:24:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047332978-network", "vif_mac": "fa:16:3e:0c:74:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047332978-network", "vif_mac": "fa:16:3e:0c:74:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG os_vif [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41fd8a32-d8e8-5b6b-8cc7-f4cc31ffba48', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6e3d304-aa, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6e3d304-aa, col_values=(('qos', UUID('391c9d7b-e6e6-4ae0-845d-d433d060314f')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6e3d304-aa, col_values=(('external_ids', {'iface-id': 'f6e3d304-aa96-4149-9ea5-9fb21f718c1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:74:2a', 'vm-uuid': '39b01e2d-c7e1-4fb0-a184-088120332b4f'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: INFO os_vif [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa')
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] No VIF found with MAC fa:16:3e:0c:74:2a, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c321a8f4-8732-4ba1-afb2-e17ca757794c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:34 user nova-compute[76391]: INFO nova.compute.manager [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Terminating instance
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Updated VIF entry in instance network info cache for port 3f8a3ffc-04a1-4462-8421-1258e8e489bf. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Updating instance_info_cache with network_info: [{"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-515270f3-9bf5-46d5-926d-7cb4d0eea5d5 req-e05651b6-c538-46b5-86ce-2b496bddb4e4 service nova] Releasing lock "refresh_cache-c321a8f4-8732-4ba1-afb2-e17ca757794c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Instance destroyed successfully.
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.objects.instance [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'resources' on Instance uuid c321a8f4-8732-4ba1-afb2-e17ca757794c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323482703',display_name='tempest-AttachVolumeNegativeTest-server-1323482703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323482703',id=28,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYgc2tBPUW0LE+/sfGgnaa4rlHvkjUKSTb0iXuI3qb0RIsccMira9FPwkZfszxSzdqHZ9kpLLF2do3Js9BSpKmrQdpz2td69EsnDdfE/bHEqUsMPpthHxVcs2hwTxRNxQ==',key_name='tempest-keypair-760532890',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-866np29c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=c321a8f4-8732-4ba1-afb2-e17ca757794c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "address": "fa:16:3e:66:4f:11", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f8a3ffc-04", "ovs_interfaceid": "3f8a3ffc-04a1-4462-8421-1258e8e489bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4f:11,bridge_name='br-int',has_traffic_filtering=True,id=3f8a3ffc-04a1-4462-8421-1258e8e489bf,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f8a3ffc-04') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG os_vif [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4f:11,bridge_name='br-int',has_traffic_filtering=True,id=3f8a3ffc-04a1-4462-8421-1258e8e489bf,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f8a3ffc-04') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-vif-unplugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] Acquiring lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] No waiting events found dispatching network-vif-unplugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-vif-unplugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] Acquiring lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] No waiting events found dispatching network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:35 user nova-compute[76391]: WARNING nova.compute.manager [req-85fa364b-7047-43a6-a0c5-8b57a8c8da9c req-ea4f823d-8a92-4474-b95f-ceaf4bacb3b5 service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received unexpected event network-vif-plugged-3f8a3ffc-04a1-4462-8421-1258e8e489bf for instance with vm_state active and task_state deleting.
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f8a3ffc-04, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=332888c8-c693-44c9-b704-43e5dd4cab1d) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:35 user nova-compute[76391]: INFO os_vif [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4f:11,bridge_name='br-int',has_traffic_filtering=True,id=3f8a3ffc-04a1-4462-8421-1258e8e489bf,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f8a3ffc-04')
Nov 15 23:24:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Deleting instance files /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c_del
Nov 15 23:24:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Deletion of /opt/stack/data/nova/instances/c321a8f4-8732-4ba1-afb2-e17ca757794c_del complete
Nov 15 23:24:35 user nova-compute[76391]: INFO nova.compute.manager [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 15 23:24:35 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:24:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG nova.compute.manager [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG nova.compute.manager [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing instance network info cache due to event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] Acquiring lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] Acquired lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG nova.network.neutron [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Snapshot image upload complete
Nov 15 23:24:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:24:37 user nova-compute[76391]: INFO nova.compute.manager [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Shelve offloading
Nov 15 23:24:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance destroyed successfully.
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquired lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:37 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Took 1.34 seconds to deallocate network for instance.
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-d46d5817-815a-41bc-af0f-edd26db71962 req-1e9abab6-44fc-4753-aaf5-1b12440c169f service nova] [instance: c321a8f4-8732-4ba1-afb2-e17ca757794c] Received event network-vif-deleted-3f8a3ffc-04a1-4462-8421-1258e8e489bf {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:37 user nova-compute[76391]: WARNING nova.compute.manager [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state active and task_state resize_finish.
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:37 user nova-compute[76391]: WARNING nova.compute.manager [req-29a790d8-bf82-415f-a09e-93018e5cb09c req-b162ba14-7a45-4391-81e0-cc1f9cbe8752 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state active and task_state resize_finish.
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.network.neutron [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updated VIF entry in instance network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.network.neutron [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5341a47c-9686-4639-8d63-f5670868546b req-cd7b399c-fdae-45e7-b28a-799b60fad2b8 service nova] Releasing lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:37 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Deleted allocations for instance c321a8f4-8732-4ba1-afb2-e17ca757794c
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b890bdea-028d-4006-8e2c-8a0116b90d19 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c321a8f4-8732-4ba1-afb2-e17ca757794c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.378s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Releasing lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:24:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance running successfully.
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Failed to set time: agent not configured {{(pid=76391) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3dcbb440-58fb-4585-88f9-4f79cbe54603 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] finish_migration finished successfully. {{(pid=76391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:38 user nova-compute[76391]: INFO nova.compute.manager [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Rebooting instance
Nov 15 23:24:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquired lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:24:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance destroyed successfully.
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'resources' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2092280647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2092280647',id=27,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUfeIkqisYhJfDtDT/7g9I/OkuxJxv/EWwZ+2KZOpmptwDdYd6iM/Tw9D5nSueupq99xMX7+T4pF4KMTFkJwL9pdjZYmqjAfPJifWRtQUFOuRUPTvsel158nyKFd1YQZg==',key_name='tempest-keypair-1514669977',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-sqngh7cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member',shelved_at='2023-11-15T23:24:36.947253',shelved_host='user',shelved_image_id='8b15aed3-15b6-48c1-aab3-ddbd7ca1265c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=3045f654-72f4-44c7-bc80-92b1b9e549a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG os_vif [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8acb3576-ff, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21c835ad-27d0-4c2f-8fe5-af906f37fd45) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:38 user nova-compute[76391]: INFO os_vif [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff')
Nov 15 23:24:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Deleting instance files /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8_del
Nov 15 23:24:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Deletion of /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8_del complete
Nov 15 23:24:38 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Deleted allocations for instance 3045f654-72f4-44c7-bc80-92b1b9e549a8
Nov 15 23:24:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'numa_topology' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.objects.base [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<3045f654-72f4-44c7-bc80-92b1b9e549a8> lazy-loaded attributes: resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Releasing lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1bdb4464-50fb-400d-a361-284883c82dba tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.212s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-unplugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-unplugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:39 user nova-compute[76391]: WARNING nova.compute.manager [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received unexpected event network-vif-unplugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:39 user nova-compute[76391]: WARNING nova.compute.manager [req-48d49c4e-db28-4583-b98d-61d6fdaae8ef req-bff23d93-b57c-41ec-bd7e-a28b7d635d46 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received unexpected event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance destroyed successfully.
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'resources' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-207908557',display_name='tempest-TestMinimumBasicScenario-server-207908557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-207908557',id=26,image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkYU4BuRcH74JoL3RVML6EL7DS6qRsR9cfY+3DTDakIKucNvSAUnIFTxShDHS0SOWAgyhhEoXTw14YuJyqN6/kCPKKgLUYs30k8pdw4yFaw5TbMk/cWhl4p6Leb6BdXg==',key_name='tempest-TestMinimumBasicScenario-832030111',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-rssk504e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:24:39Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=286506a2-7aa6-41f7-9572-38ef37ea2f7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG os_vif [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap781fe01d-41, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7587a02-9a2f-42d0-9685-04ae24a99837) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:39 user nova-compute[76391]: INFO os_vif [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41')
Nov 15 23:24:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPcyNEax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:39 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fa8684-1dca-4326-8d10-94ed68f08001]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:24:39 user nova-compute[76391]: No targets found.
Nov 15 23:24:39 user nova-compute[76391]: iSNS:
Nov 15 23:24:39 user nova-compute[76391]: No targets found.
Nov 15 23:24:39 user nova-compute[76391]: STATIC:
Nov 15 23:24:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f
Nov 15 23:24:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d
Nov 15 23:24:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:24:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:24:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:39 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:24:39 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:24:39 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:24:39 user nova-compute[76391]: FIRMWARE:
Nov 15 23:24:39 user nova-compute[76391]: No targets found.
Nov 15 23:24:39 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:24:39 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:24:39 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23be0d4c-e0d9-485a-a574-ca6481935bef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb990df1-2226-4d07-8d1c-e6359f16ba10]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405c95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ae74de-fdaf-4144-ae4f-e3c36e054ac1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc21e702-fd9a-4dbf-bf5f-903acb2db31f]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aae17d-c332-4ec9-aaaa-566cd194a989]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b0e118-faa3-4ee1-832f-37f11124a3bd]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[675303fa-25ee-4431-a3f1-f2c1fde7ddf9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7309df41-7aa5-49e5-9396-ae69cd5e16bb]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]
Nov 15 23:24:40 user nova-compute[76391]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b67fd47-66f4-4f08-a35d-0c296537150d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== disconnect_volume: return (316ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Start _get_guest_xml network_info=[{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e6611ead-79a2-44a1-9acb-fff332bbf42d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': 'e6611ead-79a2-44a1-9acb-fff332bbf42d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPcyNEax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '286506a2-7aa6-41f7-9572-38ef37ea2f7c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbe2f0c5-a2b0-4290-a376-15d59467518f', 'serial': 'cbe2f0c5-a2b0-4290-a376-15d59467518f'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '91d541fc-ad9e-4b5c-9b41-fcb66979c47f', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:24:40 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:40 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e6611ead-79a2-44a1-9acb-fff332bbf42d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'vcpu_model' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.objects.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Object Instance<286506a2-7aa6-41f7-9572-38ef37ea2f7c> lazy-loaded attributes: resources,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPcyNEax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:24:40 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:40 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:24:40 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac047b0-53ac-42a5-b040-99dd41ff401b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:24:40 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f90568-e729-4a96-b384-3d54b9705325]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f] added
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6941aa2c-eacd-45ad-bd61-02dc5ae3c51d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67cf7f7-4167-4ea2-b022-23d587b404f4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPcyNEax {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPcyNEax" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898c99f-138b-4f3a-9c31-4b99770664a7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPcyNEax'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa86f77-9afc-463b-978d-18e04e63a589]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33a662b-ef12-4837-a70f-1e63b2606fe3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27aff71-1528-4439-a979-5635e7227d52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]
Nov 15 23:24:40 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3141e22-46d8-4ffa-936e-258ef9673c4e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb8f90-d0a8-4e6b-92bc-803fee8e6ba1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:24:40 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:24:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a16899b-fe16-46d6-bf34-9d591d455a5c]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:24:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPcyNEax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26332313430633064', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332313430633064', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-207908557',display_name='tempest-TestMinimumBasicScenario-server-207908557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-207908557',id=26,image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkYU4BuRcH74JoL3RVML6EL7DS6qRsR9cfY+3DTDakIKucNvSAUnIFTxShDHS0SOWAgyhhEoXTw14YuJyqN6/kCPKKgLUYs30k8pdw4yFaw5TbMk/cWhl4p6Leb6BdXg==',key_name='tempest-TestMinimumBasicScenario-832030111',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-rssk504e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:24:39Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=286506a2-7aa6-41f7-9572-38ef37ea2f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'pci_devices' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG nova.objects.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Object Instance<286506a2-7aa6-41f7-9572-38ef37ea2f7c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:24:41 user nova-compute[76391]:   <uuid>286506a2-7aa6-41f7-9572-38ef37ea2f7c</uuid>
Nov 15 23:24:41 user nova-compute[76391]:   <name>instance-0000001a</name>
Nov 15 23:24:41 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:24:41 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:24:41 user nova-compute[76391]:   <metadata>
Nov 15 23:24:41 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:24:41 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:24:41 user nova-compute[76391]:       <nova:name>tempest-TestMinimumBasicScenario-server-207908557</nova:name>
Nov 15 23:24:41 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:24:40</nova:creationTime>
Nov 15 23:24:41 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:24:41 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:24:41 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:24:41 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:24:41 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:24:41 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:24:41 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:24:41 user nova-compute[76391]:       <nova:owner>
Nov 15 23:24:41 user nova-compute[76391]:         <nova:user uuid="3c229306bc594655839772e64b7f0200">tempest-TestMinimumBasicScenario-1692035413-project-member</nova:user>
Nov 15 23:24:41 user nova-compute[76391]:         <nova:project uuid="c852b0603a2849ae851780a32addfa7d">tempest-TestMinimumBasicScenario-1692035413</nova:project>
Nov 15 23:24:41 user nova-compute[76391]:       </nova:owner>
Nov 15 23:24:41 user nova-compute[76391]:       <nova:root type="image" uuid="e6611ead-79a2-44a1-9acb-fff332bbf42d"/>
Nov 15 23:24:41 user nova-compute[76391]:       <nova:ports>
Nov 15 23:24:41 user nova-compute[76391]:         <nova:port uuid="781fe01d-4127-45bc-8c88-ad948d96bf42">
Nov 15 23:24:41 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:24:41 user nova-compute[76391]:         </nova:port>
Nov 15 23:24:41 user nova-compute[76391]:       </nova:ports>
Nov 15 23:24:41 user nova-compute[76391]:     </nova:instance>
Nov 15 23:24:41 user nova-compute[76391]:   </metadata>
Nov 15 23:24:41 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:24:41 user nova-compute[76391]:     <system>
Nov 15 23:24:41 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:24:41 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:24:41 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:24:41 user nova-compute[76391]:       <entry name="serial">286506a2-7aa6-41f7-9572-38ef37ea2f7c</entry>
Nov 15 23:24:41 user nova-compute[76391]:       <entry name="uuid">286506a2-7aa6-41f7-9572-38ef37ea2f7c</entry>
Nov 15 23:24:41 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:24:41 user nova-compute[76391]:     </system>
Nov 15 23:24:41 user nova-compute[76391]:   </sysinfo>
Nov 15 23:24:41 user nova-compute[76391]:   <os>
Nov 15 23:24:41 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:24:41 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:24:41 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:24:41 user nova-compute[76391]:   </os>
Nov 15 23:24:41 user nova-compute[76391]:   <features>
Nov 15 23:24:41 user nova-compute[76391]:     <acpi/>
Nov 15 23:24:41 user nova-compute[76391]:     <apic/>
Nov 15 23:24:41 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:24:41 user nova-compute[76391]:   </features>
Nov 15 23:24:41 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:24:41 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:24:41 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:24:41 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:24:41 user nova-compute[76391]:   </clock>
Nov 15 23:24:41 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:24:41 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:24:41 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:24:41 user nova-compute[76391]:   </cpu>
Nov 15 23:24:41 user nova-compute[76391]:   <devices>
Nov 15 23:24:41 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:24:41 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:24:41 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk"/>
Nov 15 23:24:41 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:24:41 user nova-compute[76391]:     </disk>
Nov 15 23:24:41 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:24:41 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:24:41 user nova-compute[76391]:       <source dev="/dev/sdf"/>
Nov 15 23:24:41 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:24:41 user nova-compute[76391]:       <serial>cbe2f0c5-a2b0-4290-a376-15d59467518f</serial>
Nov 15 23:24:41 user nova-compute[76391]:     </disk>
Nov 15 23:24:41 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:24:41 user nova-compute[76391]:       <mac address="fa:16:3e:c0:90:2f"/>
Nov 15 23:24:41 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:41 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:24:41 user nova-compute[76391]:       <target dev="tap781fe01d-41"/>
Nov 15 23:24:41 user nova-compute[76391]:     </interface>
Nov 15 23:24:41 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:24:41 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/console.log" append="off"/>
Nov 15 23:24:41 user nova-compute[76391]:     </serial>
Nov 15 23:24:41 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:24:41 user nova-compute[76391]:     <video>
Nov 15 23:24:41 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:41 user nova-compute[76391]:     </video>
Nov 15 23:24:41 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:24:41 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:24:41 user nova-compute[76391]:     </rng>
Nov 15 23:24:41 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:24:41 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:24:41 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:24:41 user nova-compute[76391]:     </memballoon>
Nov 15 23:24:41 user nova-compute[76391]:   </devices>
Nov 15 23:24:41 user nova-compute[76391]: </domain>
Nov 15 23:24:41 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'trusted_certs' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.objects.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Object Instance<286506a2-7aa6-41f7-9572-38ef37ea2f7c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Cannot resize image /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'migration_context' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.objects.base [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Object Instance<286506a2-7aa6-41f7-9572-38ef37ea2f7c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-207908557',display_name='tempest-TestMinimumBasicScenario-server-207908557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-207908557',id=26,image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkYU4BuRcH74JoL3RVML6EL7DS6qRsR9cfY+3DTDakIKucNvSAUnIFTxShDHS0SOWAgyhhEoXTw14YuJyqN6/kCPKKgLUYs30k8pdw4yFaw5TbMk/cWhl4p6Leb6BdXg==',key_name='tempest-TestMinimumBasicScenario-832030111',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-rssk504e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:24:39Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=286506a2-7aa6-41f7-9572-38ef37ea2f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG os_vif [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03d319da-c4c6-562c-9be5-73a80b48b603', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap781fe01d-41, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap781fe01d-41, col_values=(('qos', UUID('47fa3449-5d8d-463d-b56d-308ffc9d084e')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap781fe01d-41, col_values=(('external_ids', {'iface-id': '781fe01d-4127-45bc-8c88-ad948d96bf42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:90:2f', 'vm-uuid': '286506a2-7aa6-41f7-9572-38ef37ea2f7c'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:42 user nova-compute[76391]: INFO os_vif [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41')
Nov 15 23:24:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:24:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:24:43 user nova-compute[76391]: INFO nova.compute.claims [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Claim successful on node user
Nov 15 23:24:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.904s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-d32a4f8e-9655-4cf0-9edf-1301d650a072 req-14886de4-5f64-4750-b19b-6036f6832f8f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d32a4f8e-9655-4cf0-9edf-1301d650a072 req-14886de4-5f64-4750-b19b-6036f6832f8f service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d32a4f8e-9655-4cf0-9edf-1301d650a072 req-14886de4-5f64-4750-b19b-6036f6832f8f service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d32a4f8e-9655-4cf0-9edf-1301d650a072 req-14886de4-5f64-4750-b19b-6036f6832f8f service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-d32a4f8e-9655-4cf0-9edf-1301d650a072 req-14886de4-5f64-4750-b19b-6036f6832f8f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:44 user nova-compute[76391]: WARNING nova.compute.manager [req-d32a4f8e-9655-4cf0-9edf-1301d650a072 req-14886de4-5f64-4750-b19b-6036f6832f8f service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received unexpected event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:24:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.policy [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323a9405e8854778bf826678f8ae876f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c28a381270e4f489acbbc7702c64c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:24:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Creating image(s)
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.239s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Successfully created port: f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.219s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk 1073741824" returned: 0 in 0.062s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Cannot resize image /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Ensure instance console log exists: /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Successfully updated port: f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received event network-changed-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Refreshing instance network info cache due to event network-changed-f9e27487-509b-42b5-abaa-ce5111dad89a. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] Acquiring lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:24:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Updating instance_info_cache with network_info: [{"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Instance network_info: |[{"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] Acquired lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Refreshing network info cache for port f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Start _get_guest_xml network_info=[{"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:24:46 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:46 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369691657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369691657',id=30,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-wljmn2l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:24:45Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=0c0d5ecf-3d9e-4715-87a4-16726b37f10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:24:75,bridge_name='br-int',has_traffic_filtering=True,id=f9e27487-509b-42b5-abaa-ce5111dad89a,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e27487-50') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.objects.instance [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c0d5ecf-3d9e-4715-87a4-16726b37f10c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:24:46 user nova-compute[76391]:   <uuid>0c0d5ecf-3d9e-4715-87a4-16726b37f10c</uuid>
Nov 15 23:24:46 user nova-compute[76391]:   <name>instance-0000001e</name>
Nov 15 23:24:46 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:24:46 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:24:46 user nova-compute[76391]:   <metadata>
Nov 15 23:24:46 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:24:46 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:24:46 user nova-compute[76391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1369691657</nova:name>
Nov 15 23:24:46 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:24:46</nova:creationTime>
Nov 15 23:24:46 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:24:46 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:24:46 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:24:46 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:24:46 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:24:46 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:24:46 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:24:46 user nova-compute[76391]:       <nova:owner>
Nov 15 23:24:46 user nova-compute[76391]:         <nova:user uuid="323a9405e8854778bf826678f8ae876f">tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member</nova:user>
Nov 15 23:24:46 user nova-compute[76391]:         <nova:project uuid="9c28a381270e4f489acbbc7702c64c61">tempest-ServerBootFromVolumeStableRescueTest-194934661</nova:project>
Nov 15 23:24:46 user nova-compute[76391]:       </nova:owner>
Nov 15 23:24:46 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:24:46 user nova-compute[76391]:       <nova:ports>
Nov 15 23:24:46 user nova-compute[76391]:         <nova:port uuid="f9e27487-509b-42b5-abaa-ce5111dad89a">
Nov 15 23:24:46 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:24:46 user nova-compute[76391]:         </nova:port>
Nov 15 23:24:46 user nova-compute[76391]:       </nova:ports>
Nov 15 23:24:46 user nova-compute[76391]:     </nova:instance>
Nov 15 23:24:46 user nova-compute[76391]:   </metadata>
Nov 15 23:24:46 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:24:46 user nova-compute[76391]:     <system>
Nov 15 23:24:46 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:24:46 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:24:46 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:24:46 user nova-compute[76391]:       <entry name="serial">0c0d5ecf-3d9e-4715-87a4-16726b37f10c</entry>
Nov 15 23:24:46 user nova-compute[76391]:       <entry name="uuid">0c0d5ecf-3d9e-4715-87a4-16726b37f10c</entry>
Nov 15 23:24:46 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:24:46 user nova-compute[76391]:     </system>
Nov 15 23:24:46 user nova-compute[76391]:   </sysinfo>
Nov 15 23:24:46 user nova-compute[76391]:   <os>
Nov 15 23:24:46 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:24:46 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:24:46 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:24:46 user nova-compute[76391]:   </os>
Nov 15 23:24:46 user nova-compute[76391]:   <features>
Nov 15 23:24:46 user nova-compute[76391]:     <acpi/>
Nov 15 23:24:46 user nova-compute[76391]:     <apic/>
Nov 15 23:24:46 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:24:46 user nova-compute[76391]:   </features>
Nov 15 23:24:46 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:24:46 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:24:46 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:24:46 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:24:46 user nova-compute[76391]:   </clock>
Nov 15 23:24:46 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:24:46 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:24:46 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:24:46 user nova-compute[76391]:   </cpu>
Nov 15 23:24:46 user nova-compute[76391]:   <devices>
Nov 15 23:24:46 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:24:46 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:24:46 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk"/>
Nov 15 23:24:46 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:24:46 user nova-compute[76391]:     </disk>
Nov 15 23:24:46 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:24:46 user nova-compute[76391]:       <mac address="fa:16:3e:f1:24:75"/>
Nov 15 23:24:46 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:46 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:24:46 user nova-compute[76391]:       <target dev="tapf9e27487-50"/>
Nov 15 23:24:46 user nova-compute[76391]:     </interface>
Nov 15 23:24:46 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:24:46 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/console.log" append="off"/>
Nov 15 23:24:46 user nova-compute[76391]:     </serial>
Nov 15 23:24:46 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:24:46 user nova-compute[76391]:     <video>
Nov 15 23:24:46 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:24:46 user nova-compute[76391]:     </video>
Nov 15 23:24:46 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:24:46 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:24:46 user nova-compute[76391]:     </rng>
Nov 15 23:24:46 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:24:46 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:24:46 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:24:46 user nova-compute[76391]:     </memballoon>
Nov 15 23:24:46 user nova-compute[76391]:   </devices>
Nov 15 23:24:46 user nova-compute[76391]: </domain>
Nov 15 23:24:46 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369691657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369691657',id=30,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-wljmn2l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:24:45Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=0c0d5ecf-3d9e-4715-87a4-16726b37f10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:24:75,bridge_name='br-int',has_traffic_filtering=True,id=f9e27487-509b-42b5-abaa-ce5111dad89a,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e27487-50') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG os_vif [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:24:75,bridge_name='br-int',has_traffic_filtering=True,id=f9e27487-509b-42b5-abaa-ce5111dad89a,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e27487-50') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e52d018-f5e9-5e99-92c3-a40715333399', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:46 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance rebooted successfully.
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9e27487-50, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9e27487-50, col_values=(('qos', UUID('e6e7d52e-ca68-40e2-bbc8-594378332a5c')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9e27487-50, col_values=(('external_ids', {'iface-id': 'f9e27487-509b-42b5-abaa-ce5111dad89a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:24:75', 'vm-uuid': '0c0d5ecf-3d9e-4715-87a4-16726b37f10c'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-bb523ffc-c44c-4cfe-a549-7f791e31f896 req-9b394e85-34bb-4518-8a31-e498cacfdbfd service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bb523ffc-c44c-4cfe-a549-7f791e31f896 req-9b394e85-34bb-4518-8a31-e498cacfdbfd service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bb523ffc-c44c-4cfe-a549-7f791e31f896 req-9b394e85-34bb-4518-8a31-e498cacfdbfd service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bb523ffc-c44c-4cfe-a549-7f791e31f896 req-9b394e85-34bb-4518-8a31-e498cacfdbfd service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-bb523ffc-c44c-4cfe-a549-7f791e31f896 req-9b394e85-34bb-4518-8a31-e498cacfdbfd service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:46 user nova-compute[76391]: WARNING nova.compute.manager [req-bb523ffc-c44c-4cfe-a549-7f791e31f896 req-9b394e85-34bb-4518-8a31-e498cacfdbfd service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received unexpected event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 23:24:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:46 user nova-compute[76391]: INFO os_vif [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:24:75,bridge_name='br-int',has_traffic_filtering=True,id=f9e27487-509b-42b5-abaa-ce5111dad89a,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e27487-50')
Nov 15 23:24:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5e8cd53a-116c-497a-9a86-67bd805d738c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No VIF found with MAC fa:16:3e:f1:24:75, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Updated VIF entry in instance network info cache for port f9e27487-509b-42b5-abaa-ce5111dad89a. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Updating instance_info_cache with network_info: [{"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7c3c65a9-ef60-4470-8d5d-d645723678fb req-f26d5cb2-b52d-4ac7-ac4f-a6f7a48b4e54 service nova] Releasing lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-e2b50b8d-4061-4176-928d-b342dd4de56f req-1ecc9311-3bad-426a-8cee-9b9478f064a5 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received event network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e2b50b8d-4061-4176-928d-b342dd4de56f req-1ecc9311-3bad-426a-8cee-9b9478f064a5 service nova] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e2b50b8d-4061-4176-928d-b342dd4de56f req-1ecc9311-3bad-426a-8cee-9b9478f064a5 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e2b50b8d-4061-4176-928d-b342dd4de56f req-1ecc9311-3bad-426a-8cee-9b9478f064a5 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-e2b50b8d-4061-4176-928d-b342dd4de56f req-1ecc9311-3bad-426a-8cee-9b9478f064a5 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] No waiting events found dispatching network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:47 user nova-compute[76391]: WARNING nova.compute.manager [req-e2b50b8d-4061-4176-928d-b342dd4de56f req-1ecc9311-3bad-426a-8cee-9b9478f064a5 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received unexpected event network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a for instance with vm_state building and task_state spawning.
Nov 15 23:24:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:24:50 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Instance spawned successfully.
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-6a2160be-3743-450f-b895-bdcdc5c25acd req-d0d9149a-d6ca-4d34-834e-ca2d4241b762 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received event network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6a2160be-3743-450f-b895-bdcdc5c25acd req-d0d9149a-d6ca-4d34-834e-ca2d4241b762 service nova] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6a2160be-3743-450f-b895-bdcdc5c25acd req-d0d9149a-d6ca-4d34-834e-ca2d4241b762 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6a2160be-3743-450f-b895-bdcdc5c25acd req-d0d9149a-d6ca-4d34-834e-ca2d4241b762 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-6a2160be-3743-450f-b895-bdcdc5c25acd req-d0d9149a-d6ca-4d34-834e-ca2d4241b762 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] No waiting events found dispatching network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:50 user nova-compute[76391]: WARNING nova.compute.manager [req-6a2160be-3743-450f-b895-bdcdc5c25acd req-d0d9149a-d6ca-4d34-834e-ca2d4241b762 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received unexpected event network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a for instance with vm_state building and task_state spawning.
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:24:50 user nova-compute[76391]: INFO nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 15 23:24:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:24:50 user nova-compute[76391]: INFO nova.compute.manager [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Took 6.77 seconds to build instance.
Nov 15 23:24:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b025edad-85b9-46b8-b1d3-064b9a8782f4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.869s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:53 user nova-compute[76391]: INFO nova.compute.manager [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Terminating instance
Nov 15 23:24:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-dc12b1df-616b-485d-ab2f-a1d4a8adb39f req-499c6f44-6eb5-43f4-ad57-ae255d897f46 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc12b1df-616b-485d-ab2f-a1d4a8adb39f req-499c6f44-6eb5-43f4-ad57-ae255d897f46 service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc12b1df-616b-485d-ab2f-a1d4a8adb39f req-499c6f44-6eb5-43f4-ad57-ae255d897f46 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc12b1df-616b-485d-ab2f-a1d4a8adb39f req-499c6f44-6eb5-43f4-ad57-ae255d897f46 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-dc12b1df-616b-485d-ab2f-a1d4a8adb39f req-499c6f44-6eb5-43f4-ad57-ae255d897f46 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-dc12b1df-616b-485d-ab2f-a1d4a8adb39f req-499c6f44-6eb5-43f4-ad57-ae255d897f46 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-unplugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Instance destroyed successfully.
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'resources' on Instance uuid e08c5f26-850b-4d4a-89ab-88f2066acc71 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1570175814',display_name='tempest-ServerActionsTestOtherA-server-1445601298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1570175814',id=16,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi7OcGSXERdzVghj+kaK9/smTbH1RoMpBm3euZr2fWrfoX9QzxsGY0Lot5k/+iXI2d+Dp+Ayun6DHTjVEDJ4lQ1BwidajYYk54Ho+5dt/K7+2DAQQWb4Y0QBXbxxb2JGA==',key_name='tempest-keypair-1702677550',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-203e6djh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e08c5f26-850b-4d4a-89ab-88f2066acc71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "address": "fa:16:3e:aa:01:54", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1754d0-2e", "ovs_interfaceid": "fb1754d0-2e26-4fb7-865d-01cea7cfed94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG os_vif [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb1754d0-2e, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f3d1c89-b1cc-4216-aa63-0359c4b2b997) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:54 user nova-compute[76391]: INFO os_vif [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:01:54,bridge_name='br-int',has_traffic_filtering=True,id=fb1754d0-2e26-4fb7-865d-01cea7cfed94,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1754d0-2e')
Nov 15 23:24:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Deleting instance files /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71_del
Nov 15 23:24:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Deletion of /opt/stack/data/nova/instances/e08c5f26-850b-4d4a-89ab-88f2066acc71_del complete
Nov 15 23:24:54 user nova-compute[76391]: INFO nova.compute.manager [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 23:24:54 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:24:54 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:24:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:24:55 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:24:55 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Took 0.69 seconds to deallocate network for instance.
Nov 15 23:24:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-9124c4a0-777d-45c5-94b5-248d04d16b00 req-985d4cbb-13b0-41fd-b158-5a4ab7f6cdb6 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-deleted-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:55 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:24:55 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:24:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:56 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Deleted allocations for instance e08c5f26-850b-4d4a-89ab-88f2066acc71
Nov 15 23:24:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-53d4db82-269f-465e-8673-3713312d5fb8 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.216s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-01a499f4-ce15-4319-90eb-91fa4d137e16 req-95e424fa-09d1-4530-956c-a47e4d306fc9 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:24:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-01a499f4-ce15-4319-90eb-91fa4d137e16 req-95e424fa-09d1-4530-956c-a47e4d306fc9 service nova] Acquiring lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:24:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-01a499f4-ce15-4319-90eb-91fa4d137e16 req-95e424fa-09d1-4530-956c-a47e4d306fc9 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:24:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-01a499f4-ce15-4319-90eb-91fa4d137e16 req-95e424fa-09d1-4530-956c-a47e4d306fc9 service nova] Lock "e08c5f26-850b-4d4a-89ab-88f2066acc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:24:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-01a499f4-ce15-4319-90eb-91fa4d137e16 req-95e424fa-09d1-4530-956c-a47e4d306fc9 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] No waiting events found dispatching network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:24:56 user nova-compute[76391]: WARNING nova.compute.manager [req-01a499f4-ce15-4319-90eb-91fa4d137e16 req-95e424fa-09d1-4530-956c-a47e4d306fc9 service nova] [instance: e08c5f26-850b-4d4a-89ab-88f2066acc71] Received unexpected event network-vif-plugged-fb1754d0-2e26-4fb7-865d-01cea7cfed94 for instance with vm_state deleted and task_state None.
Nov 15 23:24:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updating instance_info_cache with network_info: [{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:25:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:25:19 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:25:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:25:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:25 user nova-compute[76391]: INFO nova.compute.manager [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Detaching volume dfb9b491-240d-49c2-8283-e9e9a168901d
Nov 15 23:25:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:26 user nova-compute[76391]: INFO nova.virt.block_device [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Attempting to driver detach volume dfb9b491-240d-49c2-8283-e9e9a168901d from mountpoint /dev/vdb
Nov 15 23:25:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:25:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7094MB free_disk=24.861984252929688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Attempting to detach device vdb from instance c28f3f3d-8148-4c30-8070-9acff631ab32 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:25:26 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:25:26 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:25:26 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:25:26 user nova-compute[76391]:   <serial>dfb9b491-240d-49c2-8283-e9e9a168901d</serial>
Nov 15 23:25:26 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:25:26 user nova-compute[76391]: </disk>
Nov 15 23:25:26 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:25:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully detached device vdb from instance c28f3f3d-8148-4c30-8070-9acff631ab32 from the persistent domain config.
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c28f3f3d-8148-4c30-8070-9acff631ab32 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:25:26 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:25:26 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:25:26 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:25:26 user nova-compute[76391]:   <serial>dfb9b491-240d-49c2-8283-e9e9a168901d</serial>
Nov 15 23:25:26 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:25:26 user nova-compute[76391]: </disk>
Nov 15 23:25:26 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Applying migration context for instance 39b01e2d-c7e1-4fb0-a184-088120332b4f as it has an incoming, in-progress migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1. Migration status is finished {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 23:25:26 user nova-compute[76391]: INFO nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating resource usage from migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance c28f3f3d-8148-4c30-8070-9acff631ab32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 74d8883b-5873-42d1-ad25-6c8d80725a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c28f3f3d-8148-4c30-8070-9acff631ab32 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:25:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:25:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "74d8883b-5873-42d1-ad25-6c8d80725a72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:29 user nova-compute[76391]: INFO nova.compute.manager [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Terminating instance
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-4f740233-1ccc-4a59-ab8e-7e9e58c59736 req-38917a02-2a49-46f7-ba35-6a682d8541d3 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received event network-vif-unplugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4f740233-1ccc-4a59-ab8e-7e9e58c59736 req-38917a02-2a49-46f7-ba35-6a682d8541d3 service nova] Acquiring lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4f740233-1ccc-4a59-ab8e-7e9e58c59736 req-38917a02-2a49-46f7-ba35-6a682d8541d3 service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4f740233-1ccc-4a59-ab8e-7e9e58c59736 req-38917a02-2a49-46f7-ba35-6a682d8541d3 service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-4f740233-1ccc-4a59-ab8e-7e9e58c59736 req-38917a02-2a49-46f7-ba35-6a682d8541d3 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] No waiting events found dispatching network-vif-unplugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-4f740233-1ccc-4a59-ab8e-7e9e58c59736 req-38917a02-2a49-46f7-ba35-6a682d8541d3 service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received event network-vif-unplugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:25:29 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Instance destroyed successfully.
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.objects.instance [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lazy-loading 'resources' on Instance uuid 74d8883b-5873-42d1-ad25-6c8d80725a72 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:23:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2030946676',display_name='tempest-VolumesNegativeTest-instance-2030946676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2030946676',id=29,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:23:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='768e4948c25b4fa6b5de7019c2d8d2d9',ramdisk_id='',reservation_id='r-nbxgtpf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-552600431',owner_user_name='tempest-VolumesNegativeTest-552600431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:23:45Z,user_data=None,user_id='a17891477dca4dab81721bf165483d84',uuid=74d8883b-5873-42d1-ad25-6c8d80725a72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Converting VIF {"id": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "address": "fa:16:3e:05:29:65", "network": {"id": "f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51db500a5b640a2a364411daa46bdb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b3255e-5c", "ovs_interfaceid": "a3b3255e-5c2c-486a-975f-0769b0ad0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:65,bridge_name='br-int',has_traffic_filtering=True,id=a3b3255e-5c2c-486a-975f-0769b0ad0d7c,network=Network(f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b3255e-5c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG os_vif [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:65,bridge_name='br-int',has_traffic_filtering=True,id=a3b3255e-5c2c-486a-975f-0769b0ad0d7c,network=Network(f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b3255e-5c') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3b3255e-5c, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6841bdf5-8c03-484c-9d99-79c10186e014) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:29 user nova-compute[76391]: INFO os_vif [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:65,bridge_name='br-int',has_traffic_filtering=True,id=a3b3255e-5c2c-486a-975f-0769b0ad0d7c,network=Network(f5b024d7-ff8c-4861-9cf0-dd526ed1d4a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b3255e-5c')
Nov 15 23:25:29 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Deleting instance files /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72_del
Nov 15 23:25:29 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Deletion of /opt/stack/data/nova/instances/74d8883b-5873-42d1-ad25-6c8d80725a72_del complete
Nov 15 23:25:29 user nova-compute[76391]: INFO nova.compute.manager [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Took 0.63 seconds to destroy the instance on the hypervisor.
Nov 15 23:25:29 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:25:29 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:25:30 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:25:30 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Took 0.42 seconds to deallocate network for instance.
Nov 15 23:25:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:30 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:25:30 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:25:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:30 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Deleted allocations for instance 74d8883b-5873-42d1-ad25-6c8d80725a72
Nov 15 23:25:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40284eea-2326-4917-91e4-059076a8eeea tempest-VolumesNegativeTest-552600431 tempest-VolumesNegativeTest-552600431-project-member] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.752s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-b89f8a78-3ac9-4f5c-b2ed-1a85fa88d789 req-905866bc-6eb7-403a-8c87-3dd2fac7b6fe service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received event network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:25:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b89f8a78-3ac9-4f5c-b2ed-1a85fa88d789 req-905866bc-6eb7-403a-8c87-3dd2fac7b6fe service nova] Acquiring lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b89f8a78-3ac9-4f5c-b2ed-1a85fa88d789 req-905866bc-6eb7-403a-8c87-3dd2fac7b6fe service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b89f8a78-3ac9-4f5c-b2ed-1a85fa88d789 req-905866bc-6eb7-403a-8c87-3dd2fac7b6fe service nova] Lock "74d8883b-5873-42d1-ad25-6c8d80725a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-b89f8a78-3ac9-4f5c-b2ed-1a85fa88d789 req-905866bc-6eb7-403a-8c87-3dd2fac7b6fe service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] No waiting events found dispatching network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:25:31 user nova-compute[76391]: WARNING nova.compute.manager [req-b89f8a78-3ac9-4f5c-b2ed-1a85fa88d789 req-905866bc-6eb7-403a-8c87-3dd2fac7b6fe service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received unexpected event network-vif-plugged-a3b3255e-5c2c-486a-975f-0769b0ad0d7c for instance with vm_state deleted and task_state None.
Nov 15 23:25:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-b89f8a78-3ac9-4f5c-b2ed-1a85fa88d789 req-905866bc-6eb7-403a-8c87-3dd2fac7b6fe service nova] [instance: 74d8883b-5873-42d1-ad25-6c8d80725a72] Received event network-vif-deleted-a3b3255e-5c2c-486a-975f-0769b0ad0d7c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:25:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:46 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c28f3f3d-8148-4c30-8070-9acff631ab32 is timed out.
Nov 15 23:25:46 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully detached device vdb from instance c28f3f3d-8148-4c30-8070-9acff631ab32 from the live domain config.
Nov 15 23:25:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oruTcMpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:25:46 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:25:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257a2a0-c828-4838-8957-519af18a7139]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:25:46 user nova-compute[76391]: No targets found.
Nov 15 23:25:46 user nova-compute[76391]: iSNS:
Nov 15 23:25:46 user nova-compute[76391]: No targets found.
Nov 15 23:25:46 user nova-compute[76391]: STATIC:
Nov 15 23:25:46 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f
Nov 15 23:25:46 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:25:46 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:25:46 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d
Nov 15 23:25:46 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:25:46 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:25:46 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:25:46 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:25:46 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:25:46 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:25:46 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:25:46 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:25:46 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:25:46 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:25:46 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:25:46 user nova-compute[76391]: FIRMWARE:
Nov 15 23:25:46 user nova-compute[76391]: No targets found.
Nov 15 23:25:46 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:25:46 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:25:46 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6fe60e-efeb-487f-874a-1137c3bba031]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bbabca-1e73-46d2-b198-6f058bba1fe8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:25:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:25:47 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:25:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976038bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43e0cd-e950-4c38-8610-ecace439dea8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6aa868-5019-473e-ace4-8dca66358cef]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0df7a7c-23e3-4b80-8ee5-d9aac734d78f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb2ffd-cce0-4de3-85f8-c8be872d4b7a]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dafbc33-c96e-40c4-a855-c2d74316b3dd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a014227-6bf5-4275-a181-227bdfbfbb3c]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260]
Nov 15 23:25:47 user nova-compute[76391]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d, portal: 172.16.0.220,3260] successful.
Nov 15 23:25:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb9b491-240d-49c2-8283-e9e9a168901d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c69c3-865a-42cc-83f1-aa14c5823db8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== disconnect_volume: return (334ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:25:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:25:48 user nova-compute[76391]: DEBUG nova.objects.instance [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid c28f3f3d-8148-4c30-8070-9acff631ab32 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:25:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-520683bf-ef0c-4f8e-8f9d-19f2c025de1f tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.325s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:25:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:25:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:25:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:25:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:57 user nova-compute[76391]: INFO nova.compute.manager [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Unrescuing
Nov 15 23:25:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:25:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:25:57 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG nova.network.neutron [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updating instance_info_cache with network_info: [{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'flavor' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-aac5e8d4-1dc2-4b07-8f78-0bf91c3c977a req-bd1604b5-3434-46e4-99e5-9aa2d8b1dde6 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aac5e8d4-1dc2-4b07-8f78-0bf91c3c977a req-bd1604b5-3434-46e4-99e5-9aa2d8b1dde6 service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aac5e8d4-1dc2-4b07-8f78-0bf91c3c977a req-bd1604b5-3434-46e4-99e5-9aa2d8b1dde6 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aac5e8d4-1dc2-4b07-8f78-0bf91c3c977a req-bd1604b5-3434-46e4-99e5-9aa2d8b1dde6 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-aac5e8d4-1dc2-4b07-8f78-0bf91c3c977a req-bd1604b5-3434-46e4-99e5-9aa2d8b1dde6 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:25:58 user nova-compute[76391]: WARNING nova.compute.manager [req-aac5e8d4-1dc2-4b07-8f78-0bf91c3c977a req-bd1604b5-3434-46e4-99e5-9aa2d8b1dde6 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:25:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance destroyed successfully.
Nov 15 23:25:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:25:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:00 user nova-compute[76391]: WARNING nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:26:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:00 user nova-compute[76391]: WARNING nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:26:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:00 user nova-compute[76391]: WARNING nova.compute.manager [req-d6f8a196-7b6d-4577-baf5-dc24d54d865a req-54c64ab5-5bed-4f8d-b992-bd45a3147c81 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:26:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5ac52c85-b28b-4f19-b265-ef1bd23763fe tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:26:02 user nova-compute[76391]: INFO nova.compute.manager [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Unrescuing
Nov 15 23:26:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquired lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Releasing lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'flavor' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-fe2ea83c-509c-4936-8518-8c8cb3495b2c req-d8b1c014-838b-4929-a7b1-e908b8783405 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fe2ea83c-509c-4936-8518-8c8cb3495b2c req-d8b1c014-838b-4929-a7b1-e908b8783405 service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fe2ea83c-509c-4936-8518-8c8cb3495b2c req-d8b1c014-838b-4929-a7b1-e908b8783405 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fe2ea83c-509c-4936-8518-8c8cb3495b2c req-d8b1c014-838b-4929-a7b1-e908b8783405 service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-fe2ea83c-509c-4936-8518-8c8cb3495b2c req-d8b1c014-838b-4929-a7b1-e908b8783405 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:03 user nova-compute[76391]: WARNING nova.compute.manager [req-fe2ea83c-509c-4936-8518-8c8cb3495b2c req-d8b1c014-838b-4929-a7b1-e908b8783405 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:26:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance destroyed successfully.
Nov 15 23:26:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing instance network info cache due to event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Acquiring lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Acquired lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG nova.network.neutron [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing network info cache for port 15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.network.neutron [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updated VIF entry in instance network info cache for port 15463d4f-33b1-488b-85a6-ba2d5c15c10b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.network.neutron [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Releasing lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:06 user nova-compute[76391]: WARNING nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing instance network info cache due to event network-changed-15463d4f-33b1-488b-85a6-ba2d5c15c10b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Acquiring lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Acquired lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.network.neutron [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Refreshing network info cache for port 15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.network.neutron [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updated VIF entry in instance network info cache for port 15463d4f-33b1-488b-85a6-ba2d5c15c10b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.network.neutron [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [{"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Releasing lock "refresh_cache-53814dee-eafa-4742-9888-2bfcafa5ee91" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:06 user nova-compute[76391]: WARNING nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:06 user nova-compute[76391]: WARNING nova.compute.manager [req-dad8c03a-7733-4ef9-83b5-702ecf5a8232 req-4e5a3c56-ace3-4318-a006-aaa4468d90bd service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:26:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8c3d4938-a03e-4a3f-baf2-e23ffc8b3cb7 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:26:08 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Port f6e3d304-aa96-4149-9ea5-9fb21f718c1c binding to destination host user is already ACTIVE {{(pid=76391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 23:26:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquired lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:08 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Releasing lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Creating tmpfile /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/tmpf0hl78ki to verify with other compute node that the instance is on the same shared storage. {{(pid=76391) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-9897e219-9d82-42f1-b8b4-b2bc053d2234 req-fa2dd569-2b71-4e59-91a0-38369a2453d8 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9897e219-9d82-42f1-b8b4-b2bc053d2234 req-fa2dd569-2b71-4e59-91a0-38369a2453d8 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9897e219-9d82-42f1-b8b4-b2bc053d2234 req-fa2dd569-2b71-4e59-91a0-38369a2453d8 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9897e219-9d82-42f1-b8b4-b2bc053d2234 req-fa2dd569-2b71-4e59-91a0-38369a2453d8 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-9897e219-9d82-42f1-b8b4-b2bc053d2234 req-fa2dd569-2b71-4e59-91a0-38369a2453d8 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:09 user nova-compute[76391]: WARNING nova.compute.manager [req-9897e219-9d82-42f1-b8b4-b2bc053d2234 req-fa2dd569-2b71-4e59-91a0-38369a2453d8 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance destroyed successfully.
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lazy-loading 'resources' on Instance uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG os_vif [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6e3d304-aa, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=391c9d7b-e6e6-4ae0-845d-d433d060314f) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:09 user nova-compute[76391]: INFO os_vif [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa')
Nov 15 23:26:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30aa63b-656f-43dc-ae29-d5ef2d014af4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:26:10 user nova-compute[76391]: No targets found.
Nov 15 23:26:10 user nova-compute[76391]: iSNS:
Nov 15 23:26:10 user nova-compute[76391]: No targets found.
Nov 15 23:26:10 user nova-compute[76391]: STATIC:
Nov 15 23:26:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f
Nov 15 23:26:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:26:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:26:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:26:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:10 user nova-compute[76391]: FIRMWARE:
Nov 15 23:26:10 user nova-compute[76391]: No targets found.
Nov 15 23:26:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:26:10 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:26:10 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e9a1ad-9398-49d4-ac93-0d593971dabe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44867fb-5c9c-4fb0-858f-df2dad35135c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:10 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:10 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:10 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:10 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:10 user nova-compute[76391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:10 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97402efe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651'): ({'sdd'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Removing single pathed devices sdd {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc1a5f0-e407-4f56-aea8-b6bf8b4f9490]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7570a2c-9422-490f-a352-ffa6b9d6014c]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flushing IO for device /dev/sdd {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2772e6-b7fb-42c9-916f-77d2e9c667c5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f01f9c-0ac0-497e-8b02-cde9fb17de86]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7937a10-e05a-417a-bd83-c0e3f2ae1f7d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1471985f-5c60-49bd-9533-867d2c493686]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]
Nov 15 23:26:10 user nova-compute[76391]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.
Nov 15 23:26:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d389350-4452-4ea8-ab8c-7961f97372bf]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== disconnect_volume: return (333ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:26:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lazy-loading 'migration_context' on Instance uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG nova.objects.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Object Instance<39b01e2d-c7e1-4fb0-a184-088120332b4f> lazy-loaded attributes: resources,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-78456162-2e2d-4805-afff-b0b92a21b1d5 req-84d0a45f-4f95-4d49-81c9-9de1ffcb3a81 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-78456162-2e2d-4805-afff-b0b92a21b1d5 req-84d0a45f-4f95-4d49-81c9-9de1ffcb3a81 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-78456162-2e2d-4805-afff-b0b92a21b1d5 req-84d0a45f-4f95-4d49-81c9-9de1ffcb3a81 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-78456162-2e2d-4805-afff-b0b92a21b1d5 req-84d0a45f-4f95-4d49-81c9-9de1ffcb3a81 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-78456162-2e2d-4805-afff-b0b92a21b1d5 req-84d0a45f-4f95-4d49-81c9-9de1ffcb3a81 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:11 user nova-compute[76391]: WARNING nova.compute.manager [req-78456162-2e2d-4805-afff-b0b92a21b1d5 req-84d0a45f-4f95-4d49-81c9-9de1ffcb3a81 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 23:26:11 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:26:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.465s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:11 user nova-compute[76391]: INFO nova.compute.manager [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Swapping old allocation on dict_keys(['5143780f-9ae3-45b9-9ec1-f2c0aa8048b3']) held by migration 93f45c20-6316-4a21-bf1e-3fbdb328b1f1 for instance
Nov 15 23:26:11 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Overwriting current allocation {'allocations': {'5143780f-9ae3-45b9-9ec1-f2c0aa8048b3': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': 'e3ad6f3dde3a4b8b9a78f79cebabd970', 'user_id': 'a246bfc3bf184459b37f06965c15b77b', 'consumer_generation': 1} on consumer 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquired lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Releasing lock "refresh_cache-39b01e2d-c7e1-4fb0-a184-088120332b4f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG os_brick.utils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71beb9ac-b30e-46f9-957e-54ca322d5936]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[511611bc-d2fd-472b-b116-a163e57bdc88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa4cba-7fa8-4e0a-9824-6d6bf25b25d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3343fe08-0894-4daf-917f-9b2db6826c8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:12 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:26:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dc85b9-87ee-4b82-8de8-269622a6c4fc]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:26:12 user nova-compute[76391]: DEBUG os_brick.utils [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:16 user nova-compute[76391]: INFO nova.compute.manager [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Terminating instance
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-4f7bd8bc-8819-4744-9fe7-82c08a0f6a89 req-da40c9ca-9b60-4e34-89ff-c8987e1d5593 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-vif-unplugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4f7bd8bc-8819-4744-9fe7-82c08a0f6a89 req-da40c9ca-9b60-4e34-89ff-c8987e1d5593 service nova] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4f7bd8bc-8819-4744-9fe7-82c08a0f6a89 req-da40c9ca-9b60-4e34-89ff-c8987e1d5593 service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4f7bd8bc-8819-4744-9fe7-82c08a0f6a89 req-da40c9ca-9b60-4e34-89ff-c8987e1d5593 service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-4f7bd8bc-8819-4744-9fe7-82c08a0f6a89 req-da40c9ca-9b60-4e34-89ff-c8987e1d5593 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] No waiting events found dispatching network-vif-unplugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-4f7bd8bc-8819-4744-9fe7-82c08a0f6a89 req-da40c9ca-9b60-4e34-89ff-c8987e1d5593 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-vif-unplugged-bfafef15-364d-43b4-956d-63cb6f9993dd for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Instance destroyed successfully.
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.objects.instance [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'resources' on Instance uuid c28f3f3d-8148-4c30-8070-9acff631ab32 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-105165344',display_name='tempest-AttachVolumeNegativeTest-server-105165344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-105165344',id=23,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/453g9RXHyV0RSU1J+KRpzOZMYn2I+W0okjGBmpUqdhls3WgHHv57uYTt9LSkD/8TxBaOgz7FU4ldig+5UAMcSvMQtym/XKTdsh8oVAiYhl09em170G040DsGLlu26ww==',key_name='tempest-keypair-1925932212',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-blbhelr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=c28f3f3d-8148-4c30-8070-9acff631ab32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "bfafef15-364d-43b4-956d-63cb6f9993dd", "address": "fa:16:3e:5e:70:3d", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfafef15-36", "ovs_interfaceid": "bfafef15-364d-43b4-956d-63cb6f9993dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:70:3d,bridge_name='br-int',has_traffic_filtering=True,id=bfafef15-364d-43b4-956d-63cb6f9993dd,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfafef15-36') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG os_vif [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:70:3d,bridge_name='br-int',has_traffic_filtering=True,id=bfafef15-364d-43b4-956d-63cb6f9993dd,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfafef15-36') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfafef15-36, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b48b57e1-9401-48f2-a1d5-205770a09e8d) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:16 user nova-compute[76391]: INFO os_vif [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:70:3d,bridge_name='br-int',has_traffic_filtering=True,id=bfafef15-364d-43b4-956d-63cb6f9993dd,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfafef15-36')
Nov 15 23:26:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Deleting instance files /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32_del
Nov 15 23:26:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Deletion of /opt/stack/data/nova/instances/c28f3f3d-8148-4c30-8070-9acff631ab32_del complete
Nov 15 23:26:17 user nova-compute[76391]: INFO nova.compute.manager [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 23:26:17 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:26:17 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:26:17 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:26:17 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Updating instance_info_cache with network_info: [{"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-39cdf492-9c79-47f4-9437-aab5284b4dd3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:17 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:26:17 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:17 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Took 0.77 seconds to deallocate network for instance.
Nov 15 23:26:17 user nova-compute[76391]: DEBUG nova.compute.manager [req-9f7a3a8c-effd-4ff5-a78b-a7c075c6ee9e req-b4e7eac1-e5df-4155-b1e7-fe4ddc689816 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-vif-deleted-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Starting finish_revert_migration {{(pid=76391) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Start _get_guest_xml network_info=[{"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '39b01e2d-c7e1-4fb0-a184-088120332b4f', 'attached_at': '2023-11-15T23:26:18.000000', 'detached_at': '', 'volume_id': '233f5b0c-3031-473f-b106-34585ff7c651', 'serial': '233f5b0c-3031-473f-b106-34585ff7c651'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '78cc6f8c-fe3d-4981-b9ef-47e3fdd25cb3', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:18 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:18 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:18 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:18 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d8d51-f041-4b7f-8b4f-b2fc6246990e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:26:18 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7854cade-2e7e-4c01-a290-e610c8ae5d5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651] added
Nov 15 23:26:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5815b5a-7453-4085-8b04-f88e9a57778a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0779d97-3827-449d-a78b-e2a11254d385]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THVEqGil {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THVEqGil" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eca9ec-79a2-4775-b242-c1d52055bceb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THVEqGil'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9846224-a082-434a-bfa3-3de8d86e3497]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf7622-1e38-42ef-af07-ed47a0dc24a2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41464ba0-37dc-446a-bfc6-7a29e898cca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]
Nov 15 23:26:18 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.
Nov 15 23:26:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f2a524-1fe6-4981-a650-f06cb711e6d5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae27c2-3872-46fe-a230-76850d70278b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:18 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:18 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Deleted allocations for instance c28f3f3d-8148-4c30-8070-9acff631ab32
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b40397a-1efa-414b-a1b3-866d7e69ba8b]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0ced8074-82ca-443c-bd07-7b1cfd8dcb18 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-3254c53c-317e-4afa-91bb-10db10635b19 req-00750b2b-c53e-46e9-890f-d5e8dbfbecc6 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received event network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3254c53c-317e-4afa-91bb-10db10635b19 req-00750b2b-c53e-46e9-890f-d5e8dbfbecc6 service nova] Acquiring lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3254c53c-317e-4afa-91bb-10db10635b19 req-00750b2b-c53e-46e9-890f-d5e8dbfbecc6 service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3254c53c-317e-4afa-91bb-10db10635b19 req-00750b2b-c53e-46e9-890f-d5e8dbfbecc6 service nova] Lock "c28f3f3d-8148-4c30-8070-9acff631ab32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-3254c53c-317e-4afa-91bb-10db10635b19 req-00750b2b-c53e-46e9-890f-d5e8dbfbecc6 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] No waiting events found dispatching network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:18 user nova-compute[76391]: WARNING nova.compute.manager [req-3254c53c-317e-4afa-91bb-10db10635b19 req-00750b2b-c53e-46e9-890f-d5e8dbfbecc6 service nova] [instance: c28f3f3d-8148-4c30-8070-9acff631ab32] Received unexpected event network-vif-plugged-bfafef15-364d-43b4-956d-63cb6f9993dd for instance with vm_state deleted and task_state None.
Nov 15 23:26:19 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26633376462613135', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633376462613135', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:26:19 user nova-compute[76391]:   <uuid>39b01e2d-c7e1-4fb0-a184-088120332b4f</uuid>
Nov 15 23:26:19 user nova-compute[76391]:   <name>instance-00000016</name>
Nov 15 23:26:19 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:26:19 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:26:19 user nova-compute[76391]:   <metadata>
Nov 15 23:26:19 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:26:19 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:26:19 user nova-compute[76391]:       <nova:name>tempest-ServerActionsTestOtherB-server-1479706453</nova:name>
Nov 15 23:26:19 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:26:18</nova:creationTime>
Nov 15 23:26:19 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:26:19 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:26:19 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:26:19 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:26:19 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:26:19 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:26:19 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:26:19 user nova-compute[76391]:       <nova:owner>
Nov 15 23:26:19 user nova-compute[76391]:         <nova:user uuid="a246bfc3bf184459b37f06965c15b77b">tempest-ServerActionsTestOtherB-518662408-project-member</nova:user>
Nov 15 23:26:19 user nova-compute[76391]:         <nova:project uuid="e3ad6f3dde3a4b8b9a78f79cebabd970">tempest-ServerActionsTestOtherB-518662408</nova:project>
Nov 15 23:26:19 user nova-compute[76391]:       </nova:owner>
Nov 15 23:26:19 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:26:19 user nova-compute[76391]:       <nova:ports>
Nov 15 23:26:19 user nova-compute[76391]:         <nova:port uuid="f6e3d304-aa96-4149-9ea5-9fb21f718c1c">
Nov 15 23:26:19 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:26:19 user nova-compute[76391]:         </nova:port>
Nov 15 23:26:19 user nova-compute[76391]:       </nova:ports>
Nov 15 23:26:19 user nova-compute[76391]:     </nova:instance>
Nov 15 23:26:19 user nova-compute[76391]:   </metadata>
Nov 15 23:26:19 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:26:19 user nova-compute[76391]:     <system>
Nov 15 23:26:19 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:26:19 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:26:19 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:26:19 user nova-compute[76391]:       <entry name="serial">39b01e2d-c7e1-4fb0-a184-088120332b4f</entry>
Nov 15 23:26:19 user nova-compute[76391]:       <entry name="uuid">39b01e2d-c7e1-4fb0-a184-088120332b4f</entry>
Nov 15 23:26:19 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:26:19 user nova-compute[76391]:     </system>
Nov 15 23:26:19 user nova-compute[76391]:   </sysinfo>
Nov 15 23:26:19 user nova-compute[76391]:   <os>
Nov 15 23:26:19 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:26:19 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:26:19 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:26:19 user nova-compute[76391]:   </os>
Nov 15 23:26:19 user nova-compute[76391]:   <features>
Nov 15 23:26:19 user nova-compute[76391]:     <acpi/>
Nov 15 23:26:19 user nova-compute[76391]:     <apic/>
Nov 15 23:26:19 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:26:19 user nova-compute[76391]:   </features>
Nov 15 23:26:19 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:26:19 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:26:19 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:26:19 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:26:19 user nova-compute[76391]:   </clock>
Nov 15 23:26:19 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:26:19 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:26:19 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:26:19 user nova-compute[76391]:   </cpu>
Nov 15 23:26:19 user nova-compute[76391]:   <devices>
Nov 15 23:26:19 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:26:19 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:26:19 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk"/>
Nov 15 23:26:19 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:26:19 user nova-compute[76391]:     </disk>
Nov 15 23:26:19 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:26:19 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:19 user nova-compute[76391]:       <source dev="/dev/sdc"/>
Nov 15 23:26:19 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:26:19 user nova-compute[76391]:       <serial>233f5b0c-3031-473f-b106-34585ff7c651</serial>
Nov 15 23:26:19 user nova-compute[76391]:     </disk>
Nov 15 23:26:19 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:26:19 user nova-compute[76391]:       <mac address="fa:16:3e:0c:74:2a"/>
Nov 15 23:26:19 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:19 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:26:19 user nova-compute[76391]:       <target dev="tapf6e3d304-aa"/>
Nov 15 23:26:19 user nova-compute[76391]:     </interface>
Nov 15 23:26:19 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:26:19 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/console.log" append="off"/>
Nov 15 23:26:19 user nova-compute[76391]:     </serial>
Nov 15 23:26:19 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:26:19 user nova-compute[76391]:     <video>
Nov 15 23:26:19 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:19 user nova-compute[76391]:     </video>
Nov 15 23:26:19 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:26:19 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:26:19 user nova-compute[76391]:     </rng>
Nov 15 23:26:19 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:26:19 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:26:19 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:26:19 user nova-compute[76391]:     </memballoon>
Nov 15 23:26:19 user nova-compute[76391]:   </devices>
Nov 15 23:26:19 user nova-compute[76391]: </domain>
Nov 15 23:26:19 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG os_vif [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41fd8a32-d8e8-5b6b-8cc7-f4cc31ffba48', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6e3d304-aa, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6e3d304-aa, col_values=(('qos', UUID('31404b53-b206-4c20-a31e-ff9869ee7f4f')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6e3d304-aa, col_values=(('external_ids', {'iface-id': 'f6e3d304-aa96-4149-9ea5-9fb21f718c1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:74:2a', 'vm-uuid': '39b01e2d-c7e1-4fb0-a184-088120332b4f'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:19 user nova-compute[76391]: INFO os_vif [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa')
Nov 15 23:26:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG nova.compute.manager [req-6afaba2b-ceb3-4f9d-9af7-9458a348c5ce req-2d0130ab-603f-4659-b669-ae1ade3014b7 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6afaba2b-ceb3-4f9d-9af7-9458a348c5ce req-2d0130ab-603f-4659-b669-ae1ade3014b7 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6afaba2b-ceb3-4f9d-9af7-9458a348c5ce req-2d0130ab-603f-4659-b669-ae1ade3014b7 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6afaba2b-ceb3-4f9d-9af7-9458a348c5ce req-2d0130ab-603f-4659-b669-ae1ade3014b7 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG nova.compute.manager [req-6afaba2b-ceb3-4f9d-9af7-9458a348c5ce req-2d0130ab-603f-4659-b669-ae1ade3014b7 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:21 user nova-compute[76391]: WARNING nova.compute.manager [req-6afaba2b-ceb3-4f9d-9af7-9458a348c5ce req-2d0130ab-603f-4659-b669-ae1ade3014b7 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:26:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:26:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:26:23 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance running successfully.
Nov 15 23:26:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] finish_revert_migration finished successfully. {{(pid=76391) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-52084e50-7701-4126-9cdb-1b2b062cf5c7 req-ca9bd1e6-dcc9-45fc-9773-e79f6945ab71 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-52084e50-7701-4126-9cdb-1b2b062cf5c7 req-ca9bd1e6-dcc9-45fc-9773-e79f6945ab71 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-52084e50-7701-4126-9cdb-1b2b062cf5c7 req-ca9bd1e6-dcc9-45fc-9773-e79f6945ab71 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-52084e50-7701-4126-9cdb-1b2b062cf5c7 req-ca9bd1e6-dcc9-45fc-9773-e79f6945ab71 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-52084e50-7701-4126-9cdb-1b2b062cf5c7 req-ca9bd1e6-dcc9-45fc-9773-e79f6945ab71 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:23 user nova-compute[76391]: WARNING nova.compute.manager [req-52084e50-7701-4126-9cdb-1b2b062cf5c7 req-ca9bd1e6-dcc9-45fc-9773-e79f6945ab71 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:23 user nova-compute[76391]: INFO nova.compute.manager [None req-8ae44312-af22-4443-b38a-b2e789d73df3 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance to original state: 'active'
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:26:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:25 user nova-compute[76391]: INFO nova.compute.manager [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Unshelving
Nov 15 23:26:25 user nova-compute[76391]: INFO nova.virt.block_device [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Booting with volume 9df0ca94-720e-4ca2-a4cf-2766a1523484 at /dev/vdc
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG os_brick.utils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498329d-fdd9-473c-93c8-636d88e6363d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8636ac5a-27a8-4fee-91dc-41874e5e30b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[280ecffa-0fe4-4e02-8f1b-8e64f4e8fc56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dda625f-3273-4b71-bd73-00252dfb9f27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:25 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15112e00-77f2-41d0-b560-568f026f22a7]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG os_brick.utils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating existing volume attachment record: 957c380c-f067-4e64-bc89-000c98a39a3f {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:26:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:25 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7599MB free_disk=24.944480895996094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.872s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:26:26 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:29 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:29 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:29 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:29 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:29 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:26:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:26:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing instance network info cache due to event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:26:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] Acquiring lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] Acquired lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'pci_requests' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'numa_topology' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:26:31 user nova-compute[76391]: INFO nova.compute.claims [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Claim successful on node user
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.network.neutron [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updated VIF entry in instance network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.network.neutron [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5ccce741-340b-4ad3-b7f8-7c0947735c79 req-3309105c-3b62-4ed1-98bf-2efdc069d2a1 service nova] Releasing lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:26:31 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.775s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:32 user nova-compute[76391]: INFO nova.network.neutron [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating port 8acb3576-ff3c-4297-9fd7-ee981710af13 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:32 user nova-compute[76391]: INFO nova.compute.manager [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Detaching volume cbe2f0c5-a2b0-4290-a376-15d59467518f
Nov 15 23:26:32 user nova-compute[76391]: INFO nova.virt.block_device [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Attempting to driver detach volume cbe2f0c5-a2b0-4290-a376-15d59467518f from mountpoint /dev/vdb
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Attempting to detach device vdb from instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:26:32 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:32 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:26:32 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:26:32 user nova-compute[76391]:   <serial>cbe2f0c5-a2b0-4290-a376-15d59467518f</serial>
Nov 15 23:26:32 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:26:32 user nova-compute[76391]: </disk>
Nov 15 23:26:32 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:26:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully detached device vdb from instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c from the persistent domain config.
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:26:32 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:32 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:26:32 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:26:32 user nova-compute[76391]:   <serial>cbe2f0c5-a2b0-4290-a376-15d59467518f</serial>
Nov 15 23:26:32 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:26:32 user nova-compute[76391]: </disk>
Nov 15 23:26:32 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquired lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing instance network info cache due to event network-changed-781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] Acquiring lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] Acquired lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.network.neutron [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Refreshing network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-changed-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Refreshing instance network info cache due to event network-changed-8acb3576-ff3c-4297-9fd7-ee981710af13. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] Acquiring lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updated VIF entry in instance network info cache for port 781fe01d-4127-45bc-8c88-ad948d96bf42. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [{"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-257a5075-3341-4993-85ac-3f871b057ed6 req-49707f6a-1116-4766-ade2-48c9f1a0c092 service nova] Releasing lock "refresh_cache-286506a2-7aa6-41f7-9572-38ef37ea2f7c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Releasing lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:26:33 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Creating image(s)
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] Acquired lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Refreshing network info cache for port 8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG nova.objects.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<3045f654-72f4-44c7-bc80-92b1b9e549a8> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "210e55bc4418b725c6311fbdd28c802038a209bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "210e55bc4418b725c6311fbdd28c802038a209bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.part --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:34 user nova-compute[76391]: DEBUG nova.virt.images [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] 8b15aed3-15b6-48c1-aab3-ddbd7ca1265c was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:26:34 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:26:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.part /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updated VIF entry in instance network info cache for port 8acb3576-ff3c-4297-9fd7-ee981710af13. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6962a479-beb1-4b49-ad51-a78799e58b79 req-cb8a5fff-2177-4677-b64b-510d1d5e6f60 service nova] Releasing lock "refresh_cache-3045f654-72f4-44c7-bc80-92b1b9e549a8" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:35 user nova-compute[76391]: INFO nova.compute.manager [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] instance snapshotting
Nov 15 23:26:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Beginning live snapshot process
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.part /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.converted" returned: 0 in 0.785s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "210e55bc4418b725c6311fbdd28c802038a209bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.465s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:35 user nova-compute[76391]: INFO nova.compute.manager [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Detaching volume 80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json -f qcow2" returned: 0 in 0.239s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:36 user nova-compute[76391]: INFO nova.virt.block_device [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Attempting to driver detach volume 80718c96-06a2-4a85-abee-0bf416c1c891 from mountpoint /dev/vdb
Nov 15 23:26:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Attempting to detach device vdb from instance 53814dee-eafa-4742-9888-2bfcafa5ee91 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:26:36 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:36 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:26:36 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:26:36 user nova-compute[76391]:   <serial>80718c96-06a2-4a85-abee-0bf416c1c891</serial>
Nov 15 23:26:36 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:26:36 user nova-compute[76391]: </disk>
Nov 15 23:26:36 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:26:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Successfully detached device vdb from instance 53814dee-eafa-4742-9888-2bfcafa5ee91 from the persistent domain config.
Nov 15 23:26:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53814dee-eafa-4742-9888-2bfcafa5ee91 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:26:36 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:36 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:26:36 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:26:36 user nova-compute[76391]:   <serial>80718c96-06a2-4a85-abee-0bf416c1c891</serial>
Nov 15 23:26:36 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:26:36 user nova-compute[76391]: </disk>
Nov 15 23:26:36 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd --force-share --output=json" returned: 0 in 0.198s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "210e55bc4418b725c6311fbdd28c802038a209bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "210e55bc4418b725c6311fbdd28c802038a209bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json -f qcow2" returned: 0 in 0.225s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd,backing_fmt=raw /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd,backing_fmt=raw /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk 1073741824" returned: 0 in 0.059s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "210e55bc4418b725c6311fbdd28c802038a209bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa6d53f6f/25c42938dabf4d099327876935246aaf.delta 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa6d53f6f/25c42938dabf4d099327876935246aaf.delta 1073741824" returned: 0 in 0.080s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 23:26:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'migration_context' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG nova.objects.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<3045f654-72f4-44c7-bc80-92b1b9e549a8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:26:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Rebasing disk image.
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c -F raw /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:26:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:26:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 23:26:37 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:26:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa6d53f6f/25c42938dabf4d099327876935246aaf.delta /opt/stack/data/nova/instances/snapshots/tmpa6d53f6f/25c42938dabf4d099327876935246aaf {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa6d53f6f/25c42938dabf4d099327876935246aaf.delta /opt/stack/data/nova/instances/snapshots/tmpa6d53f6f/25c42938dabf4d099327876935246aaf" returned: 0 in 0.795s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Snapshot extracted, beginning image upload
Nov 15 23:26:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c -F raw /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk" returned: 0 in 2.971s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Ensure instance console log exists: /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Start _get_guest_xml network_info=[{"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6aed3bf4040b6529ae099d034cc078fd',container_format='bare',created_at=2023-11-15T23:24:32Z,direct_url=<?>,disk_format='qcow2',id=8b15aed3-15b6-48c1-aab3-ddbd7ca1265c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2092280647-shelved',owner='8145bb6c79f347f39e0a46758d3683ff',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T23:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mGZSbClR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3045f654-72f4-44c7-bc80-92b1b9e549a8', 'attached_at': '', 'detached_at': '', 'volume_id': '9df0ca94-720e-4ca2-a4cf-2766a1523484', 'serial': '9df0ca94-720e-4ca2-a4cf-2766a1523484'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdc', 'attachment_id': '957c380c-f067-4e64-bc89-000c98a39a3f', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:26:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6aed3bf4040b6529ae099d034cc078fd',container_format='bare',created_at=2023-11-15T23:24:32Z,direct_url=<?>,disk_format='qcow2',id=8b15aed3-15b6-48c1-aab3-ddbd7ca1265c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2092280647-shelved',owner='8145bb6c79f347f39e0a46758d3683ff',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T23:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.objects.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<3045f654-72f4-44c7-bc80-92b1b9e549a8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mGZSbClR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:39 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:39 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.026s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:39 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8185c5-01aa-4f7b-b760-30f27c7fddc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:26:39 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e59ad1f-b4ab-4322-9d8e-65f9f07d7cc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484] added
Nov 15 23:26:39 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a013e-76a0-45f3-b7bc-1cf916e4ad46]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a156c2-67a7-4511-8c32-c165bee35001]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:39 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mGZSbClR {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mGZSbClR" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ede2a1-a6e4-4e6d-b87b-ecbdb59011df]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mGZSbClR'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ec83f-cdc5-424f-96de-191339a87965]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[224fc565-90a4-4def-aa23-410ecce0621f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc7378-2ebe-4b76-a27d-4ce9a3695ca7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260]
Nov 15 23:26:40 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260] successful.
Nov 15 23:26:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ee40b-5703-4354-81ca-83ea3621d60b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f487a0-d7b8-449e-935d-e7417a630993]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2112934c-8671-4d00-8a7f-31cfe54375dc]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mGZSbClR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:26:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23062633331323936', 'path': '/dev/sdd'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062633331323936', 'path': '/dev/sdd'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2092280647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2092280647',id=27,image_ref='8b15aed3-15b6-48c1-aab3-ddbd7ca1265c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1514669977',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-sqngh7cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member',shelved_at='2023-11-15T23:24:36.947253',shelved_host='user',shelved_image_id='8b15aed3-15b6-48c1-aab3-ddbd7ca1265c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=3045f654-72f4-44c7-bc80-92b1b9e549a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'pci_devices' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.objects.base [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<3045f654-72f4-44c7-bc80-92b1b9e549a8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:26:41 user nova-compute[76391]:   <uuid>3045f654-72f4-44c7-bc80-92b1b9e549a8</uuid>
Nov 15 23:26:41 user nova-compute[76391]:   <name>instance-0000001b</name>
Nov 15 23:26:41 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:26:41 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:26:41 user nova-compute[76391]:   <metadata>
Nov 15 23:26:41 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:26:41 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:26:41 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2092280647</nova:name>
Nov 15 23:26:41 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:26:39</nova:creationTime>
Nov 15 23:26:41 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:26:41 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:26:41 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:26:41 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:26:41 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:26:41 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:26:41 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:26:41 user nova-compute[76391]:       <nova:owner>
Nov 15 23:26:41 user nova-compute[76391]:         <nova:user uuid="e45a3062019c454d8cc5321e130f8286">tempest-AttachVolumeShelveTestJSON-959550804-project-member</nova:user>
Nov 15 23:26:41 user nova-compute[76391]:         <nova:project uuid="8145bb6c79f347f39e0a46758d3683ff">tempest-AttachVolumeShelveTestJSON-959550804</nova:project>
Nov 15 23:26:41 user nova-compute[76391]:       </nova:owner>
Nov 15 23:26:41 user nova-compute[76391]:       <nova:root type="image" uuid="8b15aed3-15b6-48c1-aab3-ddbd7ca1265c"/>
Nov 15 23:26:41 user nova-compute[76391]:       <nova:ports>
Nov 15 23:26:41 user nova-compute[76391]:         <nova:port uuid="8acb3576-ff3c-4297-9fd7-ee981710af13">
Nov 15 23:26:41 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 23:26:41 user nova-compute[76391]:         </nova:port>
Nov 15 23:26:41 user nova-compute[76391]:       </nova:ports>
Nov 15 23:26:41 user nova-compute[76391]:     </nova:instance>
Nov 15 23:26:41 user nova-compute[76391]:   </metadata>
Nov 15 23:26:41 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:26:41 user nova-compute[76391]:     <system>
Nov 15 23:26:41 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:26:41 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:26:41 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:26:41 user nova-compute[76391]:       <entry name="serial">3045f654-72f4-44c7-bc80-92b1b9e549a8</entry>
Nov 15 23:26:41 user nova-compute[76391]:       <entry name="uuid">3045f654-72f4-44c7-bc80-92b1b9e549a8</entry>
Nov 15 23:26:41 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:26:41 user nova-compute[76391]:     </system>
Nov 15 23:26:41 user nova-compute[76391]:   </sysinfo>
Nov 15 23:26:41 user nova-compute[76391]:   <os>
Nov 15 23:26:41 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:26:41 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:26:41 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:26:41 user nova-compute[76391]:   </os>
Nov 15 23:26:41 user nova-compute[76391]:   <features>
Nov 15 23:26:41 user nova-compute[76391]:     <acpi/>
Nov 15 23:26:41 user nova-compute[76391]:     <apic/>
Nov 15 23:26:41 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:26:41 user nova-compute[76391]:   </features>
Nov 15 23:26:41 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:26:41 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:26:41 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:26:41 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:26:41 user nova-compute[76391]:   </clock>
Nov 15 23:26:41 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:26:41 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:26:41 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:26:41 user nova-compute[76391]:   </cpu>
Nov 15 23:26:41 user nova-compute[76391]:   <devices>
Nov 15 23:26:41 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:26:41 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:26:41 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk"/>
Nov 15 23:26:41 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:26:41 user nova-compute[76391]:     </disk>
Nov 15 23:26:41 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:26:41 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:41 user nova-compute[76391]:       <source dev="/dev/sdd"/>
Nov 15 23:26:41 user nova-compute[76391]:       <target dev="vdc" bus="virtio"/>
Nov 15 23:26:41 user nova-compute[76391]:       <serial>9df0ca94-720e-4ca2-a4cf-2766a1523484</serial>
Nov 15 23:26:41 user nova-compute[76391]:     </disk>
Nov 15 23:26:41 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:26:41 user nova-compute[76391]:       <mac address="fa:16:3e:c2:32:9c"/>
Nov 15 23:26:41 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:41 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:26:41 user nova-compute[76391]:       <target dev="tap8acb3576-ff"/>
Nov 15 23:26:41 user nova-compute[76391]:     </interface>
Nov 15 23:26:41 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:26:41 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/console.log" append="off"/>
Nov 15 23:26:41 user nova-compute[76391]:     </serial>
Nov 15 23:26:41 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:26:41 user nova-compute[76391]:     <video>
Nov 15 23:26:41 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:41 user nova-compute[76391]:     </video>
Nov 15 23:26:41 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:26:41 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:26:41 user nova-compute[76391]:     </rng>
Nov 15 23:26:41 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:26:41 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:26:41 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:26:41 user nova-compute[76391]:     </memballoon>
Nov 15 23:26:41 user nova-compute[76391]:   </devices>
Nov 15 23:26:41 user nova-compute[76391]: </domain>
Nov 15 23:26:41 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2092280647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2092280647',id=27,image_ref='8b15aed3-15b6-48c1-aab3-ddbd7ca1265c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1514669977',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-sqngh7cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member',shelved_at='2023-11-15T23:24:36.947253',shelved_host='user',shelved_image_id='8b15aed3-15b6-48c1-aab3-ddbd7ca1265c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=3045f654-72f4-44c7-bc80-92b1b9e549a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG os_vif [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '535179be-f81b-5d06-9f1a-aa95e8f645d3', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8acb3576-ff, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8acb3576-ff, col_values=(('qos', UUID('893b57a3-3ce0-4da3-8275-ffbf93a65e1a')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8acb3576-ff, col_values=(('external_ids', {'iface-id': '8acb3576-ff3c-4297-9fd7-ee981710af13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:32:9c', 'vm-uuid': '3045f654-72f4-44c7-bc80-92b1b9e549a8'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:41 user nova-compute[76391]: INFO os_vif [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff')
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:26:41 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No VIF found with MAC fa:16:3e:c2:32:9c, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:26:41 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Snapshot image upload complete
Nov 15 23:26:41 user nova-compute[76391]: INFO nova.compute.manager [None req-f325e7dd-c52c-4ef2-a97a-74afd4164909 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Took 6.65 seconds to snapshot the instance on the hypervisor.
Nov 15 23:26:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:26:45 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance spawned successfully.
Nov 15 23:26:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2750e3ba-2525-4b46-8c5c-451df16303a9 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.245s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-8c123794-a62e-4fcd-944d-8705e586beb4 req-2de6902e-8414-4db9-baf1-edf11a4c383f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8c123794-a62e-4fcd-944d-8705e586beb4 req-2de6902e-8414-4db9-baf1-edf11a4c383f service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8c123794-a62e-4fcd-944d-8705e586beb4 req-2de6902e-8414-4db9-baf1-edf11a4c383f service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8c123794-a62e-4fcd-944d-8705e586beb4 req-2de6902e-8414-4db9-baf1-edf11a4c383f service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-8c123794-a62e-4fcd-944d-8705e586beb4 req-2de6902e-8414-4db9-baf1-edf11a4c383f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:45 user nova-compute[76391]: WARNING nova.compute.manager [req-8c123794-a62e-4fcd-944d-8705e586beb4 req-2de6902e-8414-4db9-baf1-edf11a4c383f service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received unexpected event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with vm_state active and task_state None.
Nov 15 23:26:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-6cc38c8c-e49f-4021-bd68-d06b5300b871 req-bb46cff7-f87b-4fed-910c-74e957547a70 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6cc38c8c-e49f-4021-bd68-d06b5300b871 req-bb46cff7-f87b-4fed-910c-74e957547a70 service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6cc38c8c-e49f-4021-bd68-d06b5300b871 req-bb46cff7-f87b-4fed-910c-74e957547a70 service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6cc38c8c-e49f-4021-bd68-d06b5300b871 req-bb46cff7-f87b-4fed-910c-74e957547a70 service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-6cc38c8c-e49f-4021-bd68-d06b5300b871 req-bb46cff7-f87b-4fed-910c-74e957547a70 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:47 user nova-compute[76391]: WARNING nova.compute.manager [req-6cc38c8c-e49f-4021-bd68-d06b5300b871 req-bb46cff7-f87b-4fed-910c-74e957547a70 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received unexpected event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with vm_state active and task_state None.
Nov 15 23:26:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:26:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:26:50 user nova-compute[76391]: INFO nova.compute.claims [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Claim successful on node user
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:26:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.policy [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9170a4bb51b41d289416bb371c98a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472379097b584f5da5aa8f5c919f2e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:51 user nova-compute[76391]: INFO nova.virt.block_device [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Booting with volume 992b1ee7-6005-4918-9607-f77d35383bc8 at /dev/vda
Nov 15 23:26:51 user nova-compute[76391]: DEBUG os_brick.utils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56812d97-2c74-456e-bbfb-45f33db939dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[126dfd1c-310d-4a01-b4c8-9b9ead4dfae8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1929620-01a2-4a1e-a417-affcd9578234]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b2a3e8-a8c9-453e-aeee-cb840961214c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:51 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fc0b91-bcc6-467d-9af8-7154cfca6c36]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG os_brick.utils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating existing volume attachment record: 8c5e4cf9-dea0-47b5-ae89-98e108c0baa2 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:51 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:26:51 user nova-compute[76391]: INFO nova.compute.claims [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Claim successful on node user
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Successfully created port: 7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:26:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:26:52 user nova-compute[76391]: INFO nova.virt.block_device [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Booting with volume f256a166-9449-4554-b53c-1810162e9a20 at /dev/vda
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.policy [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44386665eb154a26b4a15de6ae2f4ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db709fa12274eab9402a50013e7db5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.utils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15220a5-7d6d-411b-b713-047a30f97d9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b316d788-df46-4122-be84-dcd688008a25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a93aac-d5dd-4b0a-b0ad-341203d12ae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37eaa17-c6c1-4f60-b209-92dcb10ce1a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:26:52 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e3a62-2b51-4d4c-ba78-41d3c4646315]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.utils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating existing volume attachment record: e687c5f5-6635-49ce-af91-f2e86473c939 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Successfully updated port: 7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:26:52 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c is timed out.
Nov 15 23:26:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully detached device vdb from instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c from the live domain config.
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPcyNEax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:52 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquired lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa49865c-16f6-464b-a667-d0d9a45560b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-changed-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Refreshing instance network info cache due to event network-changed-7931f0a9-dea3-4cf1-91f4-1039b3866903. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] Acquiring lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:26:52 user nova-compute[76391]: No targets found.
Nov 15 23:26:52 user nova-compute[76391]: iSNS:
Nov 15 23:26:52 user nova-compute[76391]: No targets found.
Nov 15 23:26:52 user nova-compute[76391]: STATIC:
Nov 15 23:26:52 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f
Nov 15 23:26:52 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:52 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:52 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:26:52 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:52 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:52 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:26:52 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:52 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:52 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:26:52 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:52 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:52 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484
Nov 15 23:26:52 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:52 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:52 user nova-compute[76391]: FIRMWARE:
Nov 15 23:26:52 user nova-compute[76391]: No targets found.
Nov 15 23:26:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:26:52 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:26:52 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[863b426b-41ea-4286-a871-d87b295ce531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da447d07-6293-4cd2-9a7e-03f66c552815]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:52 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97600eec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ef927-db20-4235-96d7-411001418724]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda2d85-8cf0-4473-8685-200d411ca82a]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af1bbe7-be0b-4fea-8efd-a44a62a0b271]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0306484-e9bf-4d90-b2c3-51e4d4ec5fc1]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd97fd9-1b98-469c-aa35-84940c1a0214]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce949044-7292-4504-bdc5-b367a55ad359]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260]
Nov 15 23:26:53 user nova-compute[76391]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f, portal: 172.16.0.220,3260] successful.
Nov 15 23:26:53 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbe2f0c5-a2b0-4290-a376-15d59467518f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f1a05-2248-4c96-ab98-d188ab65fff4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== disconnect_volume: return (342ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Releasing lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance network_info: |[{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] Acquired lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Refreshing network info cache for port 7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Successfully created port: 49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updated VIF entry in instance network info cache for port 7931f0a9-dea3-4cf1-91f4-1039b3866903. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'flavor' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17ce9094-e4c6-4c54-89f0-080a69ffd734 req-50a2999c-8973-4ec4-8779-ce84bdae4d6b service nova] Releasing lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f7b8c6e-cd39-45b7-87a7-bec41eef1d77 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.740s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Successfully updated port: 49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance network_info: |[{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing instance network info cache due to event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:26:54 user nova-compute[76391]: DEBUG nova.network.neutron [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:26:55 user nova-compute[76391]: DEBUG nova.network.neutron [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updated VIF entry in instance network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:26:55 user nova-compute[76391]: DEBUG nova.network.neutron [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:26:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f7ac9f97-77df-4856-b950-e422adb746aa req-70ab97ca-35ec-4b30-8d4c-df95edeae5d3 service nova] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:26:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53814dee-eafa-4742-9888-2bfcafa5ee91 is timed out.
Nov 15 23:26:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Successfully detached device vdb from instance 53814dee-eafa-4742-9888-2bfcafa5ee91 from the live domain config.
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsEpToHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2882b26f-12f3-4a90-8404-fb3f82f69c42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:26:56 user nova-compute[76391]: No targets found.
Nov 15 23:26:56 user nova-compute[76391]: iSNS:
Nov 15 23:26:56 user nova-compute[76391]: No targets found.
Nov 15 23:26:56 user nova-compute[76391]: STATIC:
Nov 15 23:26:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:26:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891
Nov 15 23:26:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:26:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484
Nov 15 23:26:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:26:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:26:56 user nova-compute[76391]: FIRMWARE:
Nov 15 23:26:56 user nova-compute[76391]: No targets found.
Nov 15 23:26:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:26:56 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:26:56 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf5ed0d-0404-4b95-8dae-9fd0cdb31337]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d3ac9-665f-4299-afcf-baa0ff9b2907]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:56 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:56 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:56 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:56 user nova-compute[76391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 (non-flash)
Nov 15 23:26:56 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:56 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97600eeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891'): ({'sde'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Removing single pathed devices sde {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b6bb15-b57b-461b-b7ec-e269309688e7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c96509-10e1-4656-9646-d61db723666d]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Flushing IO for device /dev/sde {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f4455-4e97-4689-a2e4-596eebcfafe1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a268a91a-01b9-46e9-ba1f-c4b5e1bf096e]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ba906-9282-4d5f-b716-87ebb9b804a5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae2b433-8da9-4a37-bc5f-c4b626357ce4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260]
Nov 15 23:26:56 user nova-compute[76391]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891, portal: 172.16.0.220,3260] successful.
Nov 15 23:26:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:26:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Creating image(s)
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Ensure instance console log exists: /opt/stack/data/nova/instances/e640c20f-d2d0-4b48-b13c-8ee8b1af864b/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Start _get_guest_xml network_info=[{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e640c20f-d2d0-4b48-b13c-8ee8b1af864b', 'attached_at': '', 'detached_at': '', 'volume_id': '992b1ee7-6005-4918-9607-f77d35383bc8', 'serial': '992b1ee7-6005-4918-9607-f77d35383bc8'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '8c5e4cf9-dea0-47b5-ae89-98e108c0baa2', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80718c96-06a2-4a85-abee-0bf416c1c891 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbcae18-b27c-4d68-a205-85c10b6e4af2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] <== disconnect_volume: return (329ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:26:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:56 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ac0a90-deb6-49f8-9ef1-f49cbc2d8f9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:26:56 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db907b-5e5b-4843-9af9-9b72f9110fe3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8] added
Nov 15 23:26:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe65124-3430-489f-90e5-55c2608f10bb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[434c96ef-65a0-4c03-b74d-cc131d141934]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOUtySWA {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOUtySWA" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfbbaa-2ecc-4158-81d6-0be6394c66c6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FOUtySWA'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fc4faf-2b7a-42c7-a115-25067e189e24]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57614dd4-5b5f-4d52-8641-6b0fc9c4478d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe3da4-3b75-4d97-8b50-ee3467b56376]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]
Nov 15 23:26:57 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.
Nov 15 23:26:57 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d872466-6012-4a2a-a7ed-9f0c5420dec9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a57412-4f64-49a8-9cac-cf428ba17a20]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:26:57 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0bf1d4-7a78-4668-99bf-70bb3ab74a39]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'flavor' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c28170b4-15da-48dd-8c07-b51c7b809ff6 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:26:57 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Creating image(s)
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Ensure instance console log exists: /opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Start _get_guest_xml network_info=[{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94e6e796-afc9-4058-840d-ae77df5ffcc3', 'attached_at': '', 'detached_at': '', 'volume_id': 'f256a166-9449-4554-b53c-1810162e9a20', 'serial': 'f256a166-9449-4554-b53c-1810162e9a20'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'e687c5f5-6635-49ce-af91-f2e86473c939', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:26:57 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:57 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:26:57 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23432646363336331', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432646363336331', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.315s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:58 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:26:58 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[597b4af4-c3c3-4f1d-bf3c-bb2540f96c1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:26:58 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-135273876',display_name='tempest-ServerActionsTestOtherA-server-135273876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-135273876',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-x0kl6uu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e640c20f-d2d0-4b48-b13c-8ee8b1af864b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'pci_devices' on Instance uuid e640c20f-d2d0-4b48-b13c-8ee8b1af864b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:26:58 user nova-compute[76391]:   <uuid>e640c20f-d2d0-4b48-b13c-8ee8b1af864b</uuid>
Nov 15 23:26:58 user nova-compute[76391]:   <name>instance-0000001f</name>
Nov 15 23:26:58 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:26:58 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:26:58 user nova-compute[76391]:   <metadata>
Nov 15 23:26:58 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:26:58 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:26:58 user nova-compute[76391]:       <nova:name>tempest-ServerActionsTestOtherA-server-135273876</nova:name>
Nov 15 23:26:58 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:26:56</nova:creationTime>
Nov 15 23:26:58 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:26:58 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:26:58 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:26:58 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:26:58 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:26:58 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:26:58 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:26:58 user nova-compute[76391]:       <nova:owner>
Nov 15 23:26:58 user nova-compute[76391]:         <nova:user uuid="c9170a4bb51b41d289416bb371c98a3b">tempest-ServerActionsTestOtherA-1370446029-project-member</nova:user>
Nov 15 23:26:58 user nova-compute[76391]:         <nova:project uuid="472379097b584f5da5aa8f5c919f2e82">tempest-ServerActionsTestOtherA-1370446029</nova:project>
Nov 15 23:26:58 user nova-compute[76391]:       </nova:owner>
Nov 15 23:26:58 user nova-compute[76391]:       <nova:ports>
Nov 15 23:26:58 user nova-compute[76391]:         <nova:port uuid="7931f0a9-dea3-4cf1-91f4-1039b3866903">
Nov 15 23:26:58 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 23:26:58 user nova-compute[76391]:         </nova:port>
Nov 15 23:26:58 user nova-compute[76391]:       </nova:ports>
Nov 15 23:26:58 user nova-compute[76391]:     </nova:instance>
Nov 15 23:26:58 user nova-compute[76391]:   </metadata>
Nov 15 23:26:58 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:26:58 user nova-compute[76391]:     <system>
Nov 15 23:26:58 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:26:58 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:26:58 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:26:58 user nova-compute[76391]:       <entry name="serial">e640c20f-d2d0-4b48-b13c-8ee8b1af864b</entry>
Nov 15 23:26:58 user nova-compute[76391]:       <entry name="uuid">e640c20f-d2d0-4b48-b13c-8ee8b1af864b</entry>
Nov 15 23:26:58 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:26:58 user nova-compute[76391]:     </system>
Nov 15 23:26:58 user nova-compute[76391]:   </sysinfo>
Nov 15 23:26:58 user nova-compute[76391]:   <os>
Nov 15 23:26:58 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:26:58 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:26:58 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:26:58 user nova-compute[76391]:   </os>
Nov 15 23:26:58 user nova-compute[76391]:   <features>
Nov 15 23:26:58 user nova-compute[76391]:     <acpi/>
Nov 15 23:26:58 user nova-compute[76391]:     <apic/>
Nov 15 23:26:58 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:26:58 user nova-compute[76391]:   </features>
Nov 15 23:26:58 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:26:58 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:26:58 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:26:58 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:26:58 user nova-compute[76391]:   </clock>
Nov 15 23:26:58 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:26:58 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:26:58 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:26:58 user nova-compute[76391]:   </cpu>
Nov 15 23:26:58 user nova-compute[76391]:   <devices>
Nov 15 23:26:58 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:26:58 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:58 user nova-compute[76391]:       <source dev="/dev/sde"/>
Nov 15 23:26:58 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:26:58 user nova-compute[76391]:       <serial>992b1ee7-6005-4918-9607-f77d35383bc8</serial>
Nov 15 23:26:58 user nova-compute[76391]:     </disk>
Nov 15 23:26:58 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:26:58 user nova-compute[76391]:       <mac address="fa:16:3e:b9:7e:a0"/>
Nov 15 23:26:58 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:58 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:26:58 user nova-compute[76391]:       <target dev="tap7931f0a9-de"/>
Nov 15 23:26:58 user nova-compute[76391]:     </interface>
Nov 15 23:26:58 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:26:58 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/e640c20f-d2d0-4b48-b13c-8ee8b1af864b/console.log" append="off"/>
Nov 15 23:26:58 user nova-compute[76391]:     </serial>
Nov 15 23:26:58 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:26:58 user nova-compute[76391]:     <video>
Nov 15 23:26:58 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:58 user nova-compute[76391]:     </video>
Nov 15 23:26:58 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:26:58 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:26:58 user nova-compute[76391]:     </rng>
Nov 15 23:26:58 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:26:58 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:26:58 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:26:58 user nova-compute[76391]:     </memballoon>
Nov 15 23:26:58 user nova-compute[76391]:   </devices>
Nov 15 23:26:58 user nova-compute[76391]: </domain>
Nov 15 23:26:58 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-135273876',display_name='tempest-ServerActionsTestOtherA-server-135273876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-135273876',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-x0kl6uu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e640c20f-d2d0-4b48-b13c-8ee8b1af864b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_vif [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ef41f8-8fe3-4886-8dd6-06d458e97aa3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20] added
Nov 15 23:26:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be9b64d8-31d0-5749-be13-b7168b0c762b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7931f0a9-de, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7931f0a9-de, col_values=(('qos', UUID('479db849-71e0-4384-b1ac-4967fc1fd650')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7931f0a9-de, col_values=(('external_ids', {'iface-id': '7931f0a9-dea3-4cf1-91f4-1039b3866903', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:7e:a0', 'vm-uuid': 'e640c20f-d2d0-4b48-b13c-8ee8b1af864b'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e650ecf-09b4-490a-a512-c9f71abf428d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:58 user nova-compute[76391]: INFO os_vif [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de')
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87afc391-9828-4632-84e2-6814d62e67b9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjLsQnBa {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjLsQnBa" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a979cee0-cf90-4a97-a994-370634bf0754]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjLsQnBa'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No VIF found with MAC fa:16:3e:b9:7e:a0, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0d85f3-fb2b-4135-93ac-bc22af318d24]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[653cb133-3849-47da-9be1-5aa42cbd4a2c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df8a23-4b12-41ca-a022-5a2e728f03ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]
Nov 15 23:26:58 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.
Nov 15 23:26:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad5c71-9fba-472f-8d61-f56eb699ee1c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c26424b-9ecb-44ae-b640-6013a80185ff]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:26:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82a9744-c9b0-4dfc-a9f4-fc4ca19db596]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:26:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] <== connect_volume: return (1663ms) {'type': 'block', 'scsi_wwn': '23732326264363834', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732326264363834', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925434621',display_name='tempest-TestShelveInstance-server-1925434621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925434621',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPrzGj1so767S6ODaoPSCzjeB6w7evmPlNZ3mvLaVmQRdlm+PESukcUE8uqVKhJOxoNqux2Ka0uJmSGp0dRzCqOIGmBzOmr8W8xGgQEr59/bAS2KNhyW4h1Ix5TKr5Kkw==',key_name='tempest-TestShelveInstance-1887119281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5db709fa12274eab9402a50013e7db5f',ramdisk_id='',reservation_id='r-ktv3zmaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2043367122',owner_user_name='tempest-TestShelveInstance-2043367122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:26:53Z,user_data=None,user_id='44386665eb154a26b4a15de6ae2f4ebb',uuid=94e6e796-afc9-4058-840d-ae77df5ffcc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converting VIF {"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'pci_devices' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:26:59 user nova-compute[76391]:   <uuid>94e6e796-afc9-4058-840d-ae77df5ffcc3</uuid>
Nov 15 23:26:59 user nova-compute[76391]:   <name>instance-00000020</name>
Nov 15 23:26:59 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:26:59 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:26:59 user nova-compute[76391]:   <metadata>
Nov 15 23:26:59 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:26:59 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:26:59 user nova-compute[76391]:       <nova:name>tempest-TestShelveInstance-server-1925434621</nova:name>
Nov 15 23:26:59 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:26:57</nova:creationTime>
Nov 15 23:26:59 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:26:59 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:26:59 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:26:59 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:26:59 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:26:59 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:26:59 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:26:59 user nova-compute[76391]:       <nova:owner>
Nov 15 23:26:59 user nova-compute[76391]:         <nova:user uuid="44386665eb154a26b4a15de6ae2f4ebb">tempest-TestShelveInstance-2043367122-project-member</nova:user>
Nov 15 23:26:59 user nova-compute[76391]:         <nova:project uuid="5db709fa12274eab9402a50013e7db5f">tempest-TestShelveInstance-2043367122</nova:project>
Nov 15 23:26:59 user nova-compute[76391]:       </nova:owner>
Nov 15 23:26:59 user nova-compute[76391]:       <nova:ports>
Nov 15 23:26:59 user nova-compute[76391]:         <nova:port uuid="49be1bfc-4b91-464c-9ce8-f25d34d5775d">
Nov 15 23:26:59 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:26:59 user nova-compute[76391]:         </nova:port>
Nov 15 23:26:59 user nova-compute[76391]:       </nova:ports>
Nov 15 23:26:59 user nova-compute[76391]:     </nova:instance>
Nov 15 23:26:59 user nova-compute[76391]:   </metadata>
Nov 15 23:26:59 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:26:59 user nova-compute[76391]:     <system>
Nov 15 23:26:59 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:26:59 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:26:59 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:26:59 user nova-compute[76391]:       <entry name="serial">94e6e796-afc9-4058-840d-ae77df5ffcc3</entry>
Nov 15 23:26:59 user nova-compute[76391]:       <entry name="uuid">94e6e796-afc9-4058-840d-ae77df5ffcc3</entry>
Nov 15 23:26:59 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:26:59 user nova-compute[76391]:     </system>
Nov 15 23:26:59 user nova-compute[76391]:   </sysinfo>
Nov 15 23:26:59 user nova-compute[76391]:   <os>
Nov 15 23:26:59 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:26:59 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:26:59 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:26:59 user nova-compute[76391]:   </os>
Nov 15 23:26:59 user nova-compute[76391]:   <features>
Nov 15 23:26:59 user nova-compute[76391]:     <acpi/>
Nov 15 23:26:59 user nova-compute[76391]:     <apic/>
Nov 15 23:26:59 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:26:59 user nova-compute[76391]:   </features>
Nov 15 23:26:59 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:26:59 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:26:59 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:26:59 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:26:59 user nova-compute[76391]:   </clock>
Nov 15 23:26:59 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:26:59 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:26:59 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:26:59 user nova-compute[76391]:   </cpu>
Nov 15 23:26:59 user nova-compute[76391]:   <devices>
Nov 15 23:26:59 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:26:59 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:26:59 user nova-compute[76391]:       <source dev="/dev/sdf"/>
Nov 15 23:26:59 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:26:59 user nova-compute[76391]:       <serial>f256a166-9449-4554-b53c-1810162e9a20</serial>
Nov 15 23:26:59 user nova-compute[76391]:     </disk>
Nov 15 23:26:59 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:26:59 user nova-compute[76391]:       <mac address="fa:16:3e:c2:1e:59"/>
Nov 15 23:26:59 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:59 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:26:59 user nova-compute[76391]:       <target dev="tap49be1bfc-4b"/>
Nov 15 23:26:59 user nova-compute[76391]:     </interface>
Nov 15 23:26:59 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:26:59 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3/console.log" append="off"/>
Nov 15 23:26:59 user nova-compute[76391]:     </serial>
Nov 15 23:26:59 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:26:59 user nova-compute[76391]:     <video>
Nov 15 23:26:59 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:26:59 user nova-compute[76391]:     </video>
Nov 15 23:26:59 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:26:59 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:26:59 user nova-compute[76391]:     </rng>
Nov 15 23:26:59 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:26:59 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:26:59 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:26:59 user nova-compute[76391]:     </memballoon>
Nov 15 23:26:59 user nova-compute[76391]:   </devices>
Nov 15 23:26:59 user nova-compute[76391]: </domain>
Nov 15 23:26:59 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925434621',display_name='tempest-TestShelveInstance-server-1925434621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925434621',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPrzGj1so767S6ODaoPSCzjeB6w7evmPlNZ3mvLaVmQRdlm+PESukcUE8uqVKhJOxoNqux2Ka0uJmSGp0dRzCqOIGmBzOmr8W8xGgQEr59/bAS2KNhyW4h1Ix5TKr5Kkw==',key_name='tempest-TestShelveInstance-1887119281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5db709fa12274eab9402a50013e7db5f',ramdisk_id='',reservation_id='r-ktv3zmaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2043367122',owner_user_name='tempest-TestShelveInstance-2043367122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:26:53Z,user_data=None,user_id='44386665eb154a26b4a15de6ae2f4ebb',uuid=94e6e796-afc9-4058-840d-ae77df5ffcc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converting VIF {"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG os_vif [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '878d160c-4a2a-5c64-84bc-2bed8ea37261', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49be1bfc-4b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49be1bfc-4b, col_values=(('qos', UUID('370fd859-59bc-42bc-be8f-b1bb3666e687')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49be1bfc-4b, col_values=(('external_ids', {'iface-id': '49be1bfc-4b91-464c-9ce8-f25d34d5775d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:1e:59', 'vm-uuid': '94e6e796-afc9-4058-840d-ae77df5ffcc3'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: INFO os_vif [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b')
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] No VIF found with MAC fa:16:3e:c2:1e:59, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-392cc072-e7e0-44c7-af57-8f0fe2c894ab req-adddfbff-6507-4e67-b716-d1f4e095b7e3 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-392cc072-e7e0-44c7-af57-8f0fe2c894ab req-adddfbff-6507-4e67-b716-d1f4e095b7e3 service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-392cc072-e7e0-44c7-af57-8f0fe2c894ab req-adddfbff-6507-4e67-b716-d1f4e095b7e3 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-392cc072-e7e0-44c7-af57-8f0fe2c894ab req-adddfbff-6507-4e67-b716-d1f4e095b7e3 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:26:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-392cc072-e7e0-44c7-af57-8f0fe2c894ab req-adddfbff-6507-4e67-b716-d1f4e095b7e3 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:26:59 user nova-compute[76391]: WARNING nova.compute.manager [req-392cc072-e7e0-44c7-af57-8f0fe2c894ab req-adddfbff-6507-4e67-b716-d1f4e095b7e3 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received unexpected event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with vm_state building and task_state spawning.
Nov 15 23:27:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-21658a15-3c79-4ef6-9d23-80fdfc2bc52d req-8c50b738-e1ba-406a-b38f-2bb2d625bbbc service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-21658a15-3c79-4ef6-9d23-80fdfc2bc52d req-8c50b738-e1ba-406a-b38f-2bb2d625bbbc service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-21658a15-3c79-4ef6-9d23-80fdfc2bc52d req-8c50b738-e1ba-406a-b38f-2bb2d625bbbc service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-21658a15-3c79-4ef6-9d23-80fdfc2bc52d req-8c50b738-e1ba-406a-b38f-2bb2d625bbbc service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-21658a15-3c79-4ef6-9d23-80fdfc2bc52d req-8c50b738-e1ba-406a-b38f-2bb2d625bbbc service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:01 user nova-compute[76391]: WARNING nova.compute.manager [req-21658a15-3c79-4ef6-9d23-80fdfc2bc52d req-8c50b738-e1ba-406a-b38f-2bb2d625bbbc service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state building and task_state spawning.
Nov 15 23:27:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-fd5f581c-0a32-4a1c-9c83-239bb93707cb req-78283413-3796-439c-93c5-7bc9fd1c255a service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fd5f581c-0a32-4a1c-9c83-239bb93707cb req-78283413-3796-439c-93c5-7bc9fd1c255a service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fd5f581c-0a32-4a1c-9c83-239bb93707cb req-78283413-3796-439c-93c5-7bc9fd1c255a service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fd5f581c-0a32-4a1c-9c83-239bb93707cb req-78283413-3796-439c-93c5-7bc9fd1c255a service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-fd5f581c-0a32-4a1c-9c83-239bb93707cb req-78283413-3796-439c-93c5-7bc9fd1c255a service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:01 user nova-compute[76391]: WARNING nova.compute.manager [req-fd5f581c-0a32-4a1c-9c83-239bb93707cb req-78283413-3796-439c-93c5-7bc9fd1c255a service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received unexpected event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with vm_state building and task_state spawning.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:27:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance spawned successfully.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: INFO nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:27:03 user nova-compute[76391]: INFO nova.compute.manager [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Took 12.54 seconds to build instance.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9a19ca13-da71-4ca8-a651-e5e7b567f9f2 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.652s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:27:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance spawned successfully.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-52ff9680-5ff8-4342-8be1-f1374108ddd1 req-7f0fce55-93e1-44ef-86af-de02f79e1225 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-52ff9680-5ff8-4342-8be1-f1374108ddd1 req-7f0fce55-93e1-44ef-86af-de02f79e1225 service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-52ff9680-5ff8-4342-8be1-f1374108ddd1 req-7f0fce55-93e1-44ef-86af-de02f79e1225 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-52ff9680-5ff8-4342-8be1-f1374108ddd1 req-7f0fce55-93e1-44ef-86af-de02f79e1225 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-52ff9680-5ff8-4342-8be1-f1374108ddd1 req-7f0fce55-93e1-44ef-86af-de02f79e1225 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:03 user nova-compute[76391]: WARNING nova.compute.manager [req-52ff9680-5ff8-4342-8be1-f1374108ddd1 req-7f0fce55-93e1-44ef-86af-de02f79e1225 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state building and task_state spawning.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:03 user nova-compute[76391]: INFO nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:27:03 user nova-compute[76391]: INFO nova.compute.manager [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Took 11.93 seconds to build instance.
Nov 15 23:27:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8771dbec-aa90-4c0e-97a6-e218a0da8041 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.037s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:27:10 user nova-compute[76391]: INFO nova.compute.claims [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Claim successful on node user
Nov 15 23:27:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:27:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:27:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.policy [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a0dc5a4052f4e9ebf3448d0ed5e5f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0d9ceea4a4748c4a4524ffb24a56e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:27:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Creating image(s)
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "/opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk 1073741824" returned: 0 in 0.045s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Successfully created port: 31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Cannot resize image /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Ensure instance console log exists: /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Successfully updated port: 31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquired lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-changed-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Refreshing instance network info cache due to event network-changed-31e0f523-8bd5-48b0-987d-1cd9c5901579. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] Acquiring lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.neutron [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updating instance_info_cache with network_info: [{"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Releasing lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Instance network_info: |[{"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] Acquired lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Refreshing network info cache for port 31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Start _get_guest_xml network_info=[{"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:27:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1542901031',display_name='tempest-AttachVolumeNegativeTest-server-1542901031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1542901031',id=33,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWfQ+AiYqYY7vjith/HDCGC8/hFEI3HkeyZKQ/3+k+HAjoPnb5qjLy7+rg5VllhMXwC6EuTh0xKdur9Rasta1mL/J14UNxL3OYkdNhgrikJ83LF+4a0cGGsu/FY9zDdGA==',key_name='tempest-keypair-1856490408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-8otocq7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=5016e2a6-3131-4107-a002-37993287edce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:ab,bridge_name='br-int',has_traffic_filtering=True,id=31e0f523-8bd5-48b0-987d-1cd9c5901579,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e0f523-8b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'pci_devices' on Instance uuid 5016e2a6-3131-4107-a002-37993287edce {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:27:12 user nova-compute[76391]:   <uuid>5016e2a6-3131-4107-a002-37993287edce</uuid>
Nov 15 23:27:12 user nova-compute[76391]:   <name>instance-00000021</name>
Nov 15 23:27:12 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:27:12 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:27:12 user nova-compute[76391]:   <metadata>
Nov 15 23:27:12 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:27:12 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:27:12 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1542901031</nova:name>
Nov 15 23:27:12 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:27:12</nova:creationTime>
Nov 15 23:27:12 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:27:12 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:27:12 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:27:12 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:27:12 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:27:12 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:27:12 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:27:12 user nova-compute[76391]:       <nova:owner>
Nov 15 23:27:12 user nova-compute[76391]:         <nova:user uuid="9a0dc5a4052f4e9ebf3448d0ed5e5f2a">tempest-AttachVolumeNegativeTest-511423013-project-member</nova:user>
Nov 15 23:27:12 user nova-compute[76391]:         <nova:project uuid="f0d9ceea4a4748c4a4524ffb24a56e97">tempest-AttachVolumeNegativeTest-511423013</nova:project>
Nov 15 23:27:12 user nova-compute[76391]:       </nova:owner>
Nov 15 23:27:12 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:27:12 user nova-compute[76391]:       <nova:ports>
Nov 15 23:27:12 user nova-compute[76391]:         <nova:port uuid="31e0f523-8bd5-48b0-987d-1cd9c5901579">
Nov 15 23:27:12 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:27:12 user nova-compute[76391]:         </nova:port>
Nov 15 23:27:12 user nova-compute[76391]:       </nova:ports>
Nov 15 23:27:12 user nova-compute[76391]:     </nova:instance>
Nov 15 23:27:12 user nova-compute[76391]:   </metadata>
Nov 15 23:27:12 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:27:12 user nova-compute[76391]:     <system>
Nov 15 23:27:12 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:27:12 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:27:12 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:27:12 user nova-compute[76391]:       <entry name="serial">5016e2a6-3131-4107-a002-37993287edce</entry>
Nov 15 23:27:12 user nova-compute[76391]:       <entry name="uuid">5016e2a6-3131-4107-a002-37993287edce</entry>
Nov 15 23:27:12 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:27:12 user nova-compute[76391]:     </system>
Nov 15 23:27:12 user nova-compute[76391]:   </sysinfo>
Nov 15 23:27:12 user nova-compute[76391]:   <os>
Nov 15 23:27:12 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:27:12 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:27:12 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:27:12 user nova-compute[76391]:   </os>
Nov 15 23:27:12 user nova-compute[76391]:   <features>
Nov 15 23:27:12 user nova-compute[76391]:     <acpi/>
Nov 15 23:27:12 user nova-compute[76391]:     <apic/>
Nov 15 23:27:12 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:27:12 user nova-compute[76391]:   </features>
Nov 15 23:27:12 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:27:12 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:27:12 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:27:12 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:27:12 user nova-compute[76391]:   </clock>
Nov 15 23:27:12 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:27:12 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:27:12 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:27:12 user nova-compute[76391]:   </cpu>
Nov 15 23:27:12 user nova-compute[76391]:   <devices>
Nov 15 23:27:12 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:27:12 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:27:12 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk"/>
Nov 15 23:27:12 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:27:12 user nova-compute[76391]:     </disk>
Nov 15 23:27:12 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:27:12 user nova-compute[76391]:       <mac address="fa:16:3e:51:a5:ab"/>
Nov 15 23:27:12 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:27:12 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:27:12 user nova-compute[76391]:       <target dev="tap31e0f523-8b"/>
Nov 15 23:27:12 user nova-compute[76391]:     </interface>
Nov 15 23:27:12 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:27:12 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/console.log" append="off"/>
Nov 15 23:27:12 user nova-compute[76391]:     </serial>
Nov 15 23:27:12 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:27:12 user nova-compute[76391]:     <video>
Nov 15 23:27:12 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:27:12 user nova-compute[76391]:     </video>
Nov 15 23:27:12 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:27:12 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:27:12 user nova-compute[76391]:     </rng>
Nov 15 23:27:12 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:27:12 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:27:12 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:27:12 user nova-compute[76391]:     </memballoon>
Nov 15 23:27:12 user nova-compute[76391]:   </devices>
Nov 15 23:27:12 user nova-compute[76391]: </domain>
Nov 15 23:27:12 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1542901031',display_name='tempest-AttachVolumeNegativeTest-server-1542901031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1542901031',id=33,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWfQ+AiYqYY7vjith/HDCGC8/hFEI3HkeyZKQ/3+k+HAjoPnb5qjLy7+rg5VllhMXwC6EuTh0xKdur9Rasta1mL/J14UNxL3OYkdNhgrikJ83LF+4a0cGGsu/FY9zDdGA==',key_name='tempest-keypair-1856490408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-8otocq7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=5016e2a6-3131-4107-a002-37993287edce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:ab,bridge_name='br-int',has_traffic_filtering=True,id=31e0f523-8bd5-48b0-987d-1cd9c5901579,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e0f523-8b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG os_vif [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:ab,bridge_name='br-int',has_traffic_filtering=True,id=31e0f523-8bd5-48b0-987d-1cd9c5901579,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e0f523-8b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '271fe544-34f7-5902-b076-2fce19f75e86', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31e0f523-8b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31e0f523-8b, col_values=(('qos', UUID('b1da0602-05cf-46aa-b29a-749f9d9f01ba')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31e0f523-8b, col_values=(('external_ids', {'iface-id': '31e0f523-8bd5-48b0-987d-1cd9c5901579', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:a5:ab', 'vm-uuid': '5016e2a6-3131-4107-a002-37993287edce'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:12 user nova-compute[76391]: INFO os_vif [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:ab,bridge_name='br-int',has_traffic_filtering=True,id=31e0f523-8bd5-48b0-987d-1cd9c5901579,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e0f523-8b')
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No VIF found with MAC fa:16:3e:51:a5:ab, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updated VIF entry in instance network info cache for port 31e0f523-8bd5-48b0-987d-1cd9c5901579. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updating instance_info_cache with network_info: [{"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e779f51c-fd33-4251-a441-aae19f20428d req-c58fe1e6-48e5-43d9-924c-d0e16ad77e7d service nova] Releasing lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:27:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-2018be53-72b3-4a30-8bf2-540a249c14f4 req-878f953d-cd1c-4c50-afdd-0dac02d805b9 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2018be53-72b3-4a30-8bf2-540a249c14f4 req-878f953d-cd1c-4c50-afdd-0dac02d805b9 service nova] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2018be53-72b3-4a30-8bf2-540a249c14f4 req-878f953d-cd1c-4c50-afdd-0dac02d805b9 service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2018be53-72b3-4a30-8bf2-540a249c14f4 req-878f953d-cd1c-4c50-afdd-0dac02d805b9 service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-2018be53-72b3-4a30-8bf2-540a249c14f4 req-878f953d-cd1c-4c50-afdd-0dac02d805b9 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] No waiting events found dispatching network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:14 user nova-compute[76391]: WARNING nova.compute.manager [req-2018be53-72b3-4a30-8bf2-540a249c14f4 req-878f953d-cd1c-4c50-afdd-0dac02d805b9 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received unexpected event network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 for instance with vm_state building and task_state spawning.
Nov 15 23:27:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:27:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 5016e2a6-3131-4107-a002-37993287edce] Instance spawned successfully.
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d66f7388-8f3f-40fe-a6ec-37be2dd5ebbc req-654ca70e-025a-4b86-b13e-a7271b79c81a service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d66f7388-8f3f-40fe-a6ec-37be2dd5ebbc req-654ca70e-025a-4b86-b13e-a7271b79c81a service nova] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d66f7388-8f3f-40fe-a6ec-37be2dd5ebbc req-654ca70e-025a-4b86-b13e-a7271b79c81a service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d66f7388-8f3f-40fe-a6ec-37be2dd5ebbc req-654ca70e-025a-4b86-b13e-a7271b79c81a service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-d66f7388-8f3f-40fe-a6ec-37be2dd5ebbc req-654ca70e-025a-4b86-b13e-a7271b79c81a service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] No waiting events found dispatching network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:16 user nova-compute[76391]: WARNING nova.compute.manager [req-d66f7388-8f3f-40fe-a6ec-37be2dd5ebbc req-654ca70e-025a-4b86-b13e-a7271b79c81a service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received unexpected event network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 for instance with vm_state building and task_state spawning.
Nov 15 23:27:16 user nova-compute[76391]: INFO nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 15 23:27:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:27:16 user nova-compute[76391]: INFO nova.compute.manager [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Took 6.00 seconds to build instance.
Nov 15 23:27:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6974e53e-b4da-4115-b040-06a53b72ab83 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.100s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:27:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:25 user nova-compute[76391]: INFO nova.compute.manager [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Terminating instance
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d140c6a-831c-475f-ab40-a1c2213f9492 req-ce0a643e-5369-41bc-aed4-995c2e79c7f2 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-unplugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d140c6a-831c-475f-ab40-a1c2213f9492 req-ce0a643e-5369-41bc-aed4-995c2e79c7f2 service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d140c6a-831c-475f-ab40-a1c2213f9492 req-ce0a643e-5369-41bc-aed4-995c2e79c7f2 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d140c6a-831c-475f-ab40-a1c2213f9492 req-ce0a643e-5369-41bc-aed4-995c2e79c7f2 service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d140c6a-831c-475f-ab40-a1c2213f9492 req-ce0a643e-5369-41bc-aed4-995c2e79c7f2 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-unplugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d140c6a-831c-475f-ab40-a1c2213f9492 req-ce0a643e-5369-41bc-aed4-995c2e79c7f2 service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-unplugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Instance destroyed successfully.
Nov 15 23:27:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7017MB free_disk=24.854530334472656GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.objects.instance [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'resources' on Instance uuid 286506a2-7aa6-41f7-9572-38ef37ea2f7c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-207908557',display_name='tempest-TestMinimumBasicScenario-server-207908557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-207908557',id=26,image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkYU4BuRcH74JoL3RVML6EL7DS6qRsR9cfY+3DTDakIKucNvSAUnIFTxShDHS0SOWAgyhhEoXTw14YuJyqN6/kCPKKgLUYs30k8pdw4yFaw5TbMk/cWhl4p6Leb6BdXg==',key_name='tempest-TestMinimumBasicScenario-832030111',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:22:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-rssk504e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6611ead-79a2-44a1-9acb-fff332bbf42d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:24:46Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=286506a2-7aa6-41f7-9572-38ef37ea2f7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "781fe01d-4127-45bc-8c88-ad948d96bf42", "address": "fa:16:3e:c0:90:2f", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781fe01d-41", "ovs_interfaceid": "781fe01d-4127-45bc-8c88-ad948d96bf42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG os_vif [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap781fe01d-41, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47fa3449-5d8d-463d-b56d-308ffc9d084e) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: INFO os_vif [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=781fe01d-4127-45bc-8c88-ad948d96bf42,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781fe01d-41')
Nov 15 23:27:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Deleting instance files /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c_del
Nov 15 23:27:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Deletion of /opt/stack/data/nova/instances/286506a2-7aa6-41f7-9572-38ef37ea2f7c_del complete
Nov 15 23:27:26 user nova-compute[76391]: INFO nova.compute.manager [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 53814dee-eafa-4742-9888-2bfcafa5ee91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 94e6e796-afc9-4058-840d-ae77df5ffcc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5016e2a6-3131-4107-a002-37993287edce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:26 user nova-compute[76391]: INFO nova.compute.manager [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Terminating instance
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:27:26 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Took 0.62 seconds to deallocate network for instance.
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-9d4c6267-2886-4f58-81b0-9682c713c675 req-c503f9d8-1f07-4ba2-a19a-62fee641379a service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-deleted-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:26 user nova-compute[76391]: INFO nova.compute.manager [req-9d4c6267-2886-4f58-81b0-9682c713c675 req-c503f9d8-1f07-4ba2-a19a-62fee641379a service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Neutron deleted interface 781fe01d-4127-45bc-8c88-ad948d96bf42; detaching it from the instance and deleting it from the info cache
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.network.neutron [req-9d4c6267-2886-4f58-81b0-9682c713c675 req-c503f9d8-1f07-4ba2-a19a-62fee641379a service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-9d4c6267-2886-4f58-81b0-9682c713c675 req-c503f9d8-1f07-4ba2-a19a-62fee641379a service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Detach interface failed, port_id=781fe01d-4127-45bc-8c88-ad948d96bf42, reason: Instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.835s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Instance destroyed successfully.
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.objects.instance [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lazy-loading 'resources' on Instance uuid 53814dee-eafa-4742-9888-2bfcafa5ee91 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-408591733',display_name='tempest-ServerStableDeviceRescueTest-server-408591733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-408591733',id=21,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJqUpSw/TXkHYm7b4bi08C4AfmdJoxvyVGSic+nhrsDXAssxcuasdq+Orfi/R/2gDVO9en5VTOxxybZiTZ8R5ELr9EXaWXDSiGrH03qbtjWWkRDaJhwFhf0qHbJeiSf8A==',key_name='tempest-keypair-729520390',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:24:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55551c07142e448bb6111c0c35fb3ee0',ramdisk_id='',reservation_id='r-m52hfv3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-802850774',owner_user_name='tempest-ServerStableDeviceRescueTest-802850774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8130ccbe83bf4c5cbc4698cd64b0007a',uuid=53814dee-eafa-4742-9888-2bfcafa5ee91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converting VIF {"id": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "address": "fa:16:3e:c9:73:56", "network": {"id": "50c3ec0e-f695-4f87-93ac-c7b3f450ff71", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-257198288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55551c07142e448bb6111c0c35fb3ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15463d4f-33", "ovs_interfaceid": "15463d4f-33b1-488b-85a6-ba2d5c15c10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG os_vif [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15463d4f-33, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a647381-5bb6-4474-beb3-b612da47fe6e) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:27 user nova-compute[76391]: INFO os_vif [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:73:56,bridge_name='br-int',has_traffic_filtering=True,id=15463d4f-33b1-488b-85a6-ba2d5c15c10b,network=Network(50c3ec0e-f695-4f87-93ac-c7b3f450ff71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15463d4f-33')
Nov 15 23:27:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Deleting instance files /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91_del
Nov 15 23:27:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Deletion of /opt/stack/data/nova/instances/53814dee-eafa-4742-9888-2bfcafa5ee91_del complete
Nov 15 23:27:27 user nova-compute[76391]: INFO nova.compute.manager [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:27 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Deleted allocations for instance 286506a2-7aa6-41f7-9572-38ef37ea2f7c
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Acquiring lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] No waiting events found dispatching network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:27 user nova-compute[76391]: WARNING nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 286506a2-7aa6-41f7-9572-38ef37ea2f7c] Received unexpected event network-vif-plugged-781fe01d-4127-45bc-8c88-ad948d96bf42 for instance with vm_state deleted and task_state None.
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-unplugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Acquiring lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] No waiting events found dispatching network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:27 user nova-compute[76391]: WARNING nova.compute.manager [req-fc1e973b-7370-42ba-901d-278d023fa12a req-2b2b778c-0c2e-4abe-9d43-a51cad7edd2d service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received unexpected event network-vif-plugged-15463d4f-33b1-488b-85a6-ba2d5c15c10b for instance with vm_state active and task_state deleting.
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3bd-5669-4aa4-81ea-3ce12092df23 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "286506a2-7aa6-41f7-9572-38ef37ea2f7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.516s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:27:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:27:28 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:28 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Took 0.84 seconds to deallocate network for instance.
Nov 15 23:27:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:27:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:27:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:28 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Deleted allocations for instance 53814dee-eafa-4742-9888-2bfcafa5ee91
Nov 15 23:27:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-159359bc-ded0-4836-bdab-5ec13cc738d0 tempest-ServerStableDeviceRescueTest-802850774 tempest-ServerStableDeviceRescueTest-802850774-project-member] Lock "53814dee-eafa-4742-9888-2bfcafa5ee91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-7bfdc596-f4c8-4b2f-9eda-17fb30bd104f req-4f2f41dd-2c66-499f-8f43-5ee0927e4360 service nova] [instance: 53814dee-eafa-4742-9888-2bfcafa5ee91] Received event network-vif-deleted-15463d4f-33b1-488b-85a6-ba2d5c15c10b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:27:44 user nova-compute[76391]: INFO nova.compute.claims [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Claim successful on node user
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:27:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:27:44 user nova-compute[76391]: DEBUG nova.policy [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323a9405e8854778bf826678f8ae876f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c28a381270e4f489acbbc7702c64c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:27:44 user nova-compute[76391]: INFO nova.virt.block_device [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Booting with volume-backed-image 9fefdfab-50b0-4bb0-961e-aba7120d0851 at /dev/vda
Nov 15 23:27:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Successfully created port: 20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Successfully updated port: 20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-changed-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Refreshing instance network info cache due to event network-changed-20867220-4b30-4291-96cc-6ff070d82773. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] Acquiring lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Updating instance_info_cache with network_info: [{"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance network_info: |[{"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] Acquired lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Refreshing network info cache for port 20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Updated VIF entry in instance network info cache for port 20867220-4b30-4291-96cc-6ff070d82773. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Updating instance_info_cache with network_info: [{"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-56e799e7-97f1-43e6-92f4-f097cfb68282 req-b3dc0d71-4799-4789-98bf-6dd23db5fcf9 service nova] Releasing lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:27:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG os_brick.utils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a8205e-986a-47ce-b392-64cdb5e88448]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8ccfb-a664-4d21-9ae3-e03f4689d9b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e85a380-3747-49eb-b6ab-7b9b8d3e5773]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65649e7c-d1e4-4add-be39-af581a68dd06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:27:50 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:27:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c63584-9a5d-4d8c-8db7-520e2b18aaff]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG os_brick.utils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:27:50 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Updating existing volume attachment record: 991c6b17-aee4-4963-b6a6-75f62b8c01a1 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:27:52 user nova-compute[76391]: INFO nova.compute.claims [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Claim successful on node user
Nov 15 23:27:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:27:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.policy [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3986dd9981e24a0f8faf441662255bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d522b2994d4474999b1a2d2d474c74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:27:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Creating image(s)
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk 1073741824" returned: 0 in 0.063s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Successfully created port: ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.201s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Cannot resize image /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Ensure instance console log exists: /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Successfully updated port: ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing instance network info cache due to event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] Acquiring lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance network_info: |[{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] Acquired lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.neutron [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Start _get_guest_xml network_info=[{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:27:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-981583528',display_name='tempest-ServerRescueNegativeTestJSON-server-981583528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-981583528',id=35,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIomkJe45ki1cIYUkPS1QNjMQCyBktjIJXwWsY7ulKFg7nff4Bz84pHhi23s1LSsAqYsBwfT0r/bsl3OIKzBSg3EyL31y7rTJAmPX658xmYM1Ec9jZsHDP4Fs215Jaumkg==',key_name='tempest-keypair-935125858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-i1klz6my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3986dd9981e24a0f8faf441662255bab',uuid=b3fb89ce-7ba2-47c7-af46-7a0051332a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'pci_devices' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:27:54 user nova-compute[76391]:   <uuid>b3fb89ce-7ba2-47c7-af46-7a0051332a0f</uuid>
Nov 15 23:27:54 user nova-compute[76391]:   <name>instance-00000023</name>
Nov 15 23:27:54 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:27:54 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:27:54 user nova-compute[76391]:   <metadata>
Nov 15 23:27:54 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:27:54 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:27:54 user nova-compute[76391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-981583528</nova:name>
Nov 15 23:27:54 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:27:54</nova:creationTime>
Nov 15 23:27:54 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:27:54 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:27:54 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:27:54 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:27:54 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:27:54 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:27:54 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:27:54 user nova-compute[76391]:       <nova:owner>
Nov 15 23:27:54 user nova-compute[76391]:         <nova:user uuid="3986dd9981e24a0f8faf441662255bab">tempest-ServerRescueNegativeTestJSON-1623431733-project-member</nova:user>
Nov 15 23:27:54 user nova-compute[76391]:         <nova:project uuid="3d522b2994d4474999b1a2d2d474c74b">tempest-ServerRescueNegativeTestJSON-1623431733</nova:project>
Nov 15 23:27:54 user nova-compute[76391]:       </nova:owner>
Nov 15 23:27:54 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:27:54 user nova-compute[76391]:       <nova:ports>
Nov 15 23:27:54 user nova-compute[76391]:         <nova:port uuid="ffb183fe-4372-4617-98a2-4e90975d4876">
Nov 15 23:27:54 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:27:54 user nova-compute[76391]:         </nova:port>
Nov 15 23:27:54 user nova-compute[76391]:       </nova:ports>
Nov 15 23:27:54 user nova-compute[76391]:     </nova:instance>
Nov 15 23:27:54 user nova-compute[76391]:   </metadata>
Nov 15 23:27:54 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:27:54 user nova-compute[76391]:     <system>
Nov 15 23:27:54 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:27:54 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:27:54 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:27:54 user nova-compute[76391]:       <entry name="serial">b3fb89ce-7ba2-47c7-af46-7a0051332a0f</entry>
Nov 15 23:27:54 user nova-compute[76391]:       <entry name="uuid">b3fb89ce-7ba2-47c7-af46-7a0051332a0f</entry>
Nov 15 23:27:54 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:27:54 user nova-compute[76391]:     </system>
Nov 15 23:27:54 user nova-compute[76391]:   </sysinfo>
Nov 15 23:27:54 user nova-compute[76391]:   <os>
Nov 15 23:27:54 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:27:54 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:27:54 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:27:54 user nova-compute[76391]:   </os>
Nov 15 23:27:54 user nova-compute[76391]:   <features>
Nov 15 23:27:54 user nova-compute[76391]:     <acpi/>
Nov 15 23:27:54 user nova-compute[76391]:     <apic/>
Nov 15 23:27:54 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:27:54 user nova-compute[76391]:   </features>
Nov 15 23:27:54 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:27:54 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:27:54 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:27:54 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:27:54 user nova-compute[76391]:   </clock>
Nov 15 23:27:54 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:27:54 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:27:54 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:27:54 user nova-compute[76391]:   </cpu>
Nov 15 23:27:54 user nova-compute[76391]:   <devices>
Nov 15 23:27:54 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:27:54 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:27:54 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk"/>
Nov 15 23:27:54 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:27:54 user nova-compute[76391]:     </disk>
Nov 15 23:27:54 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:27:54 user nova-compute[76391]:       <mac address="fa:16:3e:d9:b7:a7"/>
Nov 15 23:27:54 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:27:54 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:27:54 user nova-compute[76391]:       <target dev="tapffb183fe-43"/>
Nov 15 23:27:54 user nova-compute[76391]:     </interface>
Nov 15 23:27:54 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:27:54 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/console.log" append="off"/>
Nov 15 23:27:54 user nova-compute[76391]:     </serial>
Nov 15 23:27:54 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:27:54 user nova-compute[76391]:     <video>
Nov 15 23:27:54 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:27:54 user nova-compute[76391]:     </video>
Nov 15 23:27:54 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:27:54 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:27:54 user nova-compute[76391]:     </rng>
Nov 15 23:27:54 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:27:54 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:27:54 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:27:54 user nova-compute[76391]:     </memballoon>
Nov 15 23:27:54 user nova-compute[76391]:   </devices>
Nov 15 23:27:54 user nova-compute[76391]: </domain>
Nov 15 23:27:54 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-981583528',display_name='tempest-ServerRescueNegativeTestJSON-server-981583528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-981583528',id=35,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIomkJe45ki1cIYUkPS1QNjMQCyBktjIJXwWsY7ulKFg7nff4Bz84pHhi23s1LSsAqYsBwfT0r/bsl3OIKzBSg3EyL31y7rTJAmPX658xmYM1Ec9jZsHDP4Fs215Jaumkg==',key_name='tempest-keypair-935125858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-i1klz6my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3986dd9981e24a0f8faf441662255bab',uuid=b3fb89ce-7ba2-47c7-af46-7a0051332a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG os_vif [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a0a610f-20ed-5d0e-a10d-7a69fd6f5c80', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffb183fe-43, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffb183fe-43, col_values=(('qos', UUID('436276dd-6e95-479b-adea-bdd9b221de28')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffb183fe-43, col_values=(('external_ids', {'iface-id': 'ffb183fe-4372-4617-98a2-4e90975d4876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:b7:a7', 'vm-uuid': 'b3fb89ce-7ba2-47c7-af46-7a0051332a0f'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:54 user nova-compute[76391]: INFO os_vif [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43')
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:27:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No VIF found with MAC fa:16:3e:d9:b7:a7, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG nova.network.neutron [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updated VIF entry in instance network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG nova.network.neutron [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c895c7db-0810-444a-801d-ee7b5fbf83cd req-475de3cb-bdd5-4ac7-9460-98685981e9e8 service nova] Releasing lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:27:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Creating image(s)
Nov 15 23:27:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Ensure instance console log exists: /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Start _get_guest_xml network_info=[{"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhQxwqng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3913ccaf-90f8-4196-bb56-3cee0547dee4', 'attached_at': '', 'detached_at': '', 'volume_id': '9306311e-e3bb-4a7f-924b-d73a479fc82f', 'serial': '9306311e-e3bb-4a7f-924b-d73a479fc82f'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '991c6b17-aee4-4963-b6a6-75f62b8c01a1', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:27:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhQxwqng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:27:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:27:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:27:56 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76c48a7-ebf3-4d95-a176-56162897ae94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:27:56 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[458fafc5-a43c-40bc-bc9f-517724084536]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f] added
Nov 15 23:27:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[201d3553-5643-4414-b027-94386e613d0e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b066d-8e6d-4bc4-bd3e-9c59f009ebd9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhQxwqng {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhQxwqng" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1814af0-0c3e-4c39-9551-1b1cb80734a2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhQxwqng'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf21430-3b19-4fce-9b06-d50607c629f9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127969e-c601-44b6-8998-cde1937f8842]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-38bd8b67-fa0b-4c8b-b0e7-934202debeb9 req-50171b35-8588-4537-b584-964fc637f41f service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38bd8b67-fa0b-4c8b-b0e7-934202debeb9 req-50171b35-8588-4537-b584-964fc637f41f service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38bd8b67-fa0b-4c8b-b0e7-934202debeb9 req-50171b35-8588-4537-b584-964fc637f41f service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38bd8b67-fa0b-4c8b-b0e7-934202debeb9 req-50171b35-8588-4537-b584-964fc637f41f service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-38bd8b67-fa0b-4c8b-b0e7-934202debeb9 req-50171b35-8588-4537-b584-964fc637f41f service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:56 user nova-compute[76391]: WARNING nova.compute.manager [req-38bd8b67-fa0b-4c8b-b0e7-934202debeb9 req-50171b35-8588-4537-b584-964fc637f41f service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state building and task_state spawning.
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[473843e3-2846-4de9-9e06-fb404dbc2c85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260]
Nov 15 23:27:56 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260] successful.
Nov 15 23:27:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be21f53-2194-422f-9940-d505137aec7a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e701f8-124e-4fef-a467-4378db1d4852]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:27:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:27:56 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:27:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[349189ea-0867-4333-bfcf-8811186b4d1c]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:27:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhQxwqng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26336353463663962', 'path': '/dev/sdg'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336353463663962', 'path': '/dev/sdg'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-425566497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-425566497',id=34,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-uqewve0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:27:45Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=3913ccaf-90f8-4196-bb56-3cee0547dee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'pci_devices' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:27:57 user nova-compute[76391]:   <uuid>3913ccaf-90f8-4196-bb56-3cee0547dee4</uuid>
Nov 15 23:27:57 user nova-compute[76391]:   <name>instance-00000022</name>
Nov 15 23:27:57 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:27:57 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:27:57 user nova-compute[76391]:   <metadata>
Nov 15 23:27:57 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:27:57 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:27:57 user nova-compute[76391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-425566497</nova:name>
Nov 15 23:27:57 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:27:56</nova:creationTime>
Nov 15 23:27:57 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:27:57 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:27:57 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:27:57 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:27:57 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:27:57 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:27:57 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:27:57 user nova-compute[76391]:       <nova:owner>
Nov 15 23:27:57 user nova-compute[76391]:         <nova:user uuid="323a9405e8854778bf826678f8ae876f">tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member</nova:user>
Nov 15 23:27:57 user nova-compute[76391]:         <nova:project uuid="9c28a381270e4f489acbbc7702c64c61">tempest-ServerBootFromVolumeStableRescueTest-194934661</nova:project>
Nov 15 23:27:57 user nova-compute[76391]:       </nova:owner>
Nov 15 23:27:57 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:27:57 user nova-compute[76391]:       <nova:ports>
Nov 15 23:27:57 user nova-compute[76391]:         <nova:port uuid="20867220-4b30-4291-96cc-6ff070d82773">
Nov 15 23:27:57 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 23:27:57 user nova-compute[76391]:         </nova:port>
Nov 15 23:27:57 user nova-compute[76391]:       </nova:ports>
Nov 15 23:27:57 user nova-compute[76391]:     </nova:instance>
Nov 15 23:27:57 user nova-compute[76391]:   </metadata>
Nov 15 23:27:57 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:27:57 user nova-compute[76391]:     <system>
Nov 15 23:27:57 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:27:57 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:27:57 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:27:57 user nova-compute[76391]:       <entry name="serial">3913ccaf-90f8-4196-bb56-3cee0547dee4</entry>
Nov 15 23:27:57 user nova-compute[76391]:       <entry name="uuid">3913ccaf-90f8-4196-bb56-3cee0547dee4</entry>
Nov 15 23:27:57 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:27:57 user nova-compute[76391]:     </system>
Nov 15 23:27:57 user nova-compute[76391]:   </sysinfo>
Nov 15 23:27:57 user nova-compute[76391]:   <os>
Nov 15 23:27:57 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:27:57 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:27:57 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:27:57 user nova-compute[76391]:   </os>
Nov 15 23:27:57 user nova-compute[76391]:   <features>
Nov 15 23:27:57 user nova-compute[76391]:     <acpi/>
Nov 15 23:27:57 user nova-compute[76391]:     <apic/>
Nov 15 23:27:57 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:27:57 user nova-compute[76391]:   </features>
Nov 15 23:27:57 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:27:57 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:27:57 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:27:57 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:27:57 user nova-compute[76391]:   </clock>
Nov 15 23:27:57 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:27:57 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:27:57 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:27:57 user nova-compute[76391]:   </cpu>
Nov 15 23:27:57 user nova-compute[76391]:   <devices>
Nov 15 23:27:57 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:27:57 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:27:57 user nova-compute[76391]:       <source dev="/dev/sdg"/>
Nov 15 23:27:57 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:27:57 user nova-compute[76391]:       <serial>9306311e-e3bb-4a7f-924b-d73a479fc82f</serial>
Nov 15 23:27:57 user nova-compute[76391]:     </disk>
Nov 15 23:27:57 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:27:57 user nova-compute[76391]:       <mac address="fa:16:3e:20:83:e4"/>
Nov 15 23:27:57 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:27:57 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:27:57 user nova-compute[76391]:       <target dev="tap20867220-4b"/>
Nov 15 23:27:57 user nova-compute[76391]:     </interface>
Nov 15 23:27:57 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:27:57 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/console.log" append="off"/>
Nov 15 23:27:57 user nova-compute[76391]:     </serial>
Nov 15 23:27:57 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:27:57 user nova-compute[76391]:     <video>
Nov 15 23:27:57 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:27:57 user nova-compute[76391]:     </video>
Nov 15 23:27:57 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:27:57 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:27:57 user nova-compute[76391]:     </rng>
Nov 15 23:27:57 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:27:57 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:27:57 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:27:57 user nova-compute[76391]:     </memballoon>
Nov 15 23:27:57 user nova-compute[76391]:   </devices>
Nov 15 23:27:57 user nova-compute[76391]: </domain>
Nov 15 23:27:57 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-425566497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-425566497',id=34,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-uqewve0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:27:45Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=3913ccaf-90f8-4196-bb56-3cee0547dee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG os_vif [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '831249cb-40ba-5277-bb1c-38b35a4498f1', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20867220-4b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20867220-4b, col_values=(('qos', UUID('eac060b6-a7ad-4cd5-b878-56f00fa5b44f')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20867220-4b, col_values=(('external_ids', {'iface-id': '20867220-4b30-4291-96cc-6ff070d82773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:83:e4', 'vm-uuid': '3913ccaf-90f8-4196-bb56-3cee0547dee4'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:57 user nova-compute[76391]: INFO os_vif [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b')
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:27:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No VIF found with MAC fa:16:3e:20:83:e4, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:27:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance spawned successfully.
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:27:58 user nova-compute[76391]: INFO nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-9dbe3a98-7b3e-4764-91ab-c230d4c0aa37 req-7ddfeb95-4e15-4603-8004-67fc39fc4c80 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9dbe3a98-7b3e-4764-91ab-c230d4c0aa37 req-7ddfeb95-4e15-4603-8004-67fc39fc4c80 service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9dbe3a98-7b3e-4764-91ab-c230d4c0aa37 req-7ddfeb95-4e15-4603-8004-67fc39fc4c80 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9dbe3a98-7b3e-4764-91ab-c230d4c0aa37 req-7ddfeb95-4e15-4603-8004-67fc39fc4c80 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-9dbe3a98-7b3e-4764-91ab-c230d4c0aa37 req-7ddfeb95-4e15-4603-8004-67fc39fc4c80 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:27:58 user nova-compute[76391]: WARNING nova.compute.manager [req-9dbe3a98-7b3e-4764-91ab-c230d4c0aa37 req-7ddfeb95-4e15-4603-8004-67fc39fc4c80 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state building and task_state spawning.
Nov 15 23:27:58 user nova-compute[76391]: INFO nova.compute.manager [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Took 6.25 seconds to build instance.
Nov 15 23:27:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ede381e2-6a7a-463b-beb0-a4b0d0fba525 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.339s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:27:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:00 user nova-compute[76391]: WARNING nova.compute.manager [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state building and task_state spawning.
Nov 15 23:28:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:00 user nova-compute[76391]: WARNING nova.compute.manager [req-17837898-578a-4d74-bf1f-570eac310faf req-c0c6369a-7017-420a-b71a-d280f16fb651 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state building and task_state spawning.
Nov 15 23:28:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:28:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance spawned successfully.
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:01 user nova-compute[76391]: INFO nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 15 23:28:01 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:28:01 user nova-compute[76391]: INFO nova.compute.manager [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Took 17.01 seconds to build instance.
Nov 15 23:28:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2c14b8df-2a82-4dab-bd7d-e273f58e0fac tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.105s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:11 user nova-compute[76391]: INFO nova.compute.manager [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Terminating instance
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-1b12783a-a029-4d5e-a9d8-45f3ea2e6f73 req-d81d79fc-e6f4-426f-bb9b-0cd5cc5a2fb4 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received event network-vif-unplugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1b12783a-a029-4d5e-a9d8-45f3ea2e6f73 req-d81d79fc-e6f4-426f-bb9b-0cd5cc5a2fb4 service nova] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1b12783a-a029-4d5e-a9d8-45f3ea2e6f73 req-d81d79fc-e6f4-426f-bb9b-0cd5cc5a2fb4 service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1b12783a-a029-4d5e-a9d8-45f3ea2e6f73 req-d81d79fc-e6f4-426f-bb9b-0cd5cc5a2fb4 service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-1b12783a-a029-4d5e-a9d8-45f3ea2e6f73 req-d81d79fc-e6f4-426f-bb9b-0cd5cc5a2fb4 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] No waiting events found dispatching network-vif-unplugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-1b12783a-a029-4d5e-a9d8-45f3ea2e6f73 req-d81d79fc-e6f4-426f-bb9b-0cd5cc5a2fb4 service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received event network-vif-unplugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Instance destroyed successfully.
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lazy-loading 'resources' on Instance uuid 39cdf492-9c79-47f4-9437-aab5284b4dd3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1742095287',display_name='tempest-ServersNegativeTestJSON-server-1742095287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1742095287',id=19,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bc691a9d5674fbb898dd6736e91613f',ramdisk_id='',reservation_id='r-5xxovw50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-686980340',owner_user_name='tempest-ServersNegativeTestJSON-686980340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:19:35Z,user_data=None,user_id='9d5fb40133174f4db6f71696591de2a8',uuid=39cdf492-9c79-47f4-9437-aab5284b4dd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converting VIF {"id": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "address": "fa:16:3e:a2:a7:27", "network": {"id": "23179e41-0a3f-4422-991f-4540a7e21870", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2000761685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc691a9d5674fbb898dd6736e91613f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c20a743-d1", "ovs_interfaceid": "7c20a743-d1b7-49b9-b84d-f9b1e7262230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c20a743-d1b7-49b9-b84d-f9b1e7262230,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c20a743-d1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG os_vif [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c20a743-d1b7-49b9-b84d-f9b1e7262230,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c20a743-d1') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c20a743-d1, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e4492e6-2820-4dcd-93a3-e663d0342461) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:11 user nova-compute[76391]: INFO os_vif [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a7:27,bridge_name='br-int',has_traffic_filtering=True,id=7c20a743-d1b7-49b9-b84d-f9b1e7262230,network=Network(23179e41-0a3f-4422-991f-4540a7e21870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c20a743-d1')
Nov 15 23:28:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Deleting instance files /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3_del
Nov 15 23:28:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Deletion of /opt/stack/data/nova/instances/39cdf492-9c79-47f4-9437-aab5284b4dd3_del complete
Nov 15 23:28:11 user nova-compute[76391]: INFO nova.compute.manager [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 15 23:28:11 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:28:11 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:28:12 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:12 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Took 0.45 seconds to deallocate network for instance.
Nov 15 23:28:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-a2f9daf8-ea2c-4c7c-9021-e50d301523a3 req-0a06b9bc-1325-4db8-9973-4d98dbc527ae service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received event network-vif-deleted-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:12 user nova-compute[76391]: INFO nova.compute.manager [req-a2f9daf8-ea2c-4c7c-9021-e50d301523a3 req-0a06b9bc-1325-4db8-9973-4d98dbc527ae service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Neutron deleted interface 7c20a743-d1b7-49b9-b84d-f9b1e7262230; detaching it from the instance and deleting it from the info cache
Nov 15 23:28:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-a2f9daf8-ea2c-4c7c-9021-e50d301523a3 req-0a06b9bc-1325-4db8-9973-4d98dbc527ae service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-a2f9daf8-ea2c-4c7c-9021-e50d301523a3 req-0a06b9bc-1325-4db8-9973-4d98dbc527ae service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Detach interface failed, port_id=7c20a743-d1b7-49b9-b84d-f9b1e7262230, reason: Instance 39cdf492-9c79-47f4-9437-aab5284b4dd3 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:28:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:12 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:28:12 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:28:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:12 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Deleted allocations for instance 39cdf492-9c79-47f4-9437-aab5284b4dd3
Nov 15 23:28:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-28df7a21-733d-41f3-ab78-85fdb3b8ae1d tempest-ServersNegativeTestJSON-686980340 tempest-ServersNegativeTestJSON-686980340-project-member] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.809s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-4973d2c9-7089-47a8-a499-bbdae4ab2a62 req-41c5f498-43f2-45c9-9560-b4147dc1d6ca service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received event network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4973d2c9-7089-47a8-a499-bbdae4ab2a62 req-41c5f498-43f2-45c9-9560-b4147dc1d6ca service nova] Acquiring lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4973d2c9-7089-47a8-a499-bbdae4ab2a62 req-41c5f498-43f2-45c9-9560-b4147dc1d6ca service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4973d2c9-7089-47a8-a499-bbdae4ab2a62 req-41c5f498-43f2-45c9-9560-b4147dc1d6ca service nova] Lock "39cdf492-9c79-47f4-9437-aab5284b4dd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-4973d2c9-7089-47a8-a499-bbdae4ab2a62 req-41c5f498-43f2-45c9-9560-b4147dc1d6ca service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] No waiting events found dispatching network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:13 user nova-compute[76391]: WARNING nova.compute.manager [req-4973d2c9-7089-47a8-a499-bbdae4ab2a62 req-41c5f498-43f2-45c9-9560-b4147dc1d6ca service nova] [instance: 39cdf492-9c79-47f4-9437-aab5284b4dd3] Received unexpected event network-vif-plugged-7c20a743-d1b7-49b9-b84d-f9b1e7262230 for instance with vm_state deleted and task_state None.
Nov 15 23:28:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:15 user nova-compute[76391]: INFO nova.compute.manager [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Detaching volume 9df0ca94-720e-4ca2-a4cf-2766a1523484
Nov 15 23:28:15 user nova-compute[76391]: INFO nova.virt.block_device [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Attempting to driver detach volume 9df0ca94-720e-4ca2-a4cf-2766a1523484 from mountpoint /dev/vdc
Nov 15 23:28:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Attempting to detach device vdc from instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:28:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:28:15 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:28:15 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:28:15 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:28:15 user nova-compute[76391]:   <serial>9df0ca94-720e-4ca2-a4cf-2766a1523484</serial>
Nov 15 23:28:15 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:28:15 user nova-compute[76391]: </disk>
Nov 15 23:28:15 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:28:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully detached device vdc from instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 from the persistent domain config.
Nov 15 23:28:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:28:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:28:15 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:28:15 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:28:15 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:28:15 user nova-compute[76391]:   <serial>9df0ca94-720e-4ca2-a4cf-2766a1523484</serial>
Nov 15 23:28:15 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:28:15 user nova-compute[76391]: </disk>
Nov 15 23:28:15 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:28:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:28:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:18 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:28:18 user nova-compute[76391]: INFO nova.compute.claims [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Claim successful on node user
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:28:19 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.policy [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c229306bc594655839772e64b7f0200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852b0603a2849ae851780a32addfa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:28:19 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Creating image(s)
Nov 15 23:28:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "/opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "/opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "/opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Successfully created port: 6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.part --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.virt.images [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] 475afe99-564c-47e9-a7f3-1316f0fbdc78 was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.part /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.part /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.converted" returned: 0 in 0.274s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.094s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Successfully updated port: 6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquired lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing instance network info cache due to event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] Acquiring lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de,backing_fmt=raw /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de,backing_fmt=raw /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk 1073741824" returned: 0 in 0.047s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Releasing lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance network_info: |[{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] Acquired lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.neutron [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Cannot resize image /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Ensure instance console log exists: /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Start _get_guest_xml network_info=[{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:28:16Z,direct_url=<?>,disk_format='qcow2',id=475afe99-564c-47e9-a7f3-1316f0fbdc78,min_disk=0,min_ram=0,name='tempest-scenario-img--555165810',owner='c852b0603a2849ae851780a32addfa7d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:28:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '475afe99-564c-47e9-a7f3-1316f0fbdc78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:28:21 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:21 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:28:16Z,direct_url=<?>,disk_format='qcow2',id=475afe99-564c-47e9-a7f3-1316f0fbdc78,min_disk=0,min_ram=0,name='tempest-scenario-img--555165810',owner='c852b0603a2849ae851780a32addfa7d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:28:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1384069568',display_name='tempest-TestMinimumBasicScenario-server-1384069568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1384069568',id=36,image_ref='475afe99-564c-47e9-a7f3-1316f0fbdc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1NJSHD042FhzQbQPREnPE2/S6iDbzKlj7Z78M6S+vpwCWtPfnO+/nlK/lh/apXWW4MLqWbCq4xUV8ThzpZUbxRxSqoOJh34r3WCTJyB3wsND3oHv1BniuTvkWC5zT/Pw==',key_name='tempest-TestMinimumBasicScenario-661759224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-uftdiewc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='475afe99-564c-47e9-a7f3-1316f0fbdc78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:20Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=745360bd-e3db-4960-870a-ea1889afff5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=6242d910-98a4-4458-90fa-b4ad2bc9d3f3,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6242d910-98') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'pci_devices' on Instance uuid 745360bd-e3db-4960-870a-ea1889afff5a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:28:21 user nova-compute[76391]:   <uuid>745360bd-e3db-4960-870a-ea1889afff5a</uuid>
Nov 15 23:28:21 user nova-compute[76391]:   <name>instance-00000024</name>
Nov 15 23:28:21 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:28:21 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:28:21 user nova-compute[76391]:   <metadata>
Nov 15 23:28:21 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:28:21 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:28:21 user nova-compute[76391]:       <nova:name>tempest-TestMinimumBasicScenario-server-1384069568</nova:name>
Nov 15 23:28:21 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:28:21</nova:creationTime>
Nov 15 23:28:21 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:28:21 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:28:21 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:28:21 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:28:21 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:28:21 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:28:21 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:28:21 user nova-compute[76391]:       <nova:owner>
Nov 15 23:28:21 user nova-compute[76391]:         <nova:user uuid="3c229306bc594655839772e64b7f0200">tempest-TestMinimumBasicScenario-1692035413-project-member</nova:user>
Nov 15 23:28:21 user nova-compute[76391]:         <nova:project uuid="c852b0603a2849ae851780a32addfa7d">tempest-TestMinimumBasicScenario-1692035413</nova:project>
Nov 15 23:28:21 user nova-compute[76391]:       </nova:owner>
Nov 15 23:28:21 user nova-compute[76391]:       <nova:root type="image" uuid="475afe99-564c-47e9-a7f3-1316f0fbdc78"/>
Nov 15 23:28:21 user nova-compute[76391]:       <nova:ports>
Nov 15 23:28:21 user nova-compute[76391]:         <nova:port uuid="6242d910-98a4-4458-90fa-b4ad2bc9d3f3">
Nov 15 23:28:21 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:28:21 user nova-compute[76391]:         </nova:port>
Nov 15 23:28:21 user nova-compute[76391]:       </nova:ports>
Nov 15 23:28:21 user nova-compute[76391]:     </nova:instance>
Nov 15 23:28:21 user nova-compute[76391]:   </metadata>
Nov 15 23:28:21 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:28:21 user nova-compute[76391]:     <system>
Nov 15 23:28:21 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:28:21 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:28:21 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:28:21 user nova-compute[76391]:       <entry name="serial">745360bd-e3db-4960-870a-ea1889afff5a</entry>
Nov 15 23:28:21 user nova-compute[76391]:       <entry name="uuid">745360bd-e3db-4960-870a-ea1889afff5a</entry>
Nov 15 23:28:21 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:28:21 user nova-compute[76391]:     </system>
Nov 15 23:28:21 user nova-compute[76391]:   </sysinfo>
Nov 15 23:28:21 user nova-compute[76391]:   <os>
Nov 15 23:28:21 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:28:21 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:28:21 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:28:21 user nova-compute[76391]:   </os>
Nov 15 23:28:21 user nova-compute[76391]:   <features>
Nov 15 23:28:21 user nova-compute[76391]:     <acpi/>
Nov 15 23:28:21 user nova-compute[76391]:     <apic/>
Nov 15 23:28:21 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:28:21 user nova-compute[76391]:   </features>
Nov 15 23:28:21 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:28:21 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:28:21 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:28:21 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:28:21 user nova-compute[76391]:   </clock>
Nov 15 23:28:21 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:28:21 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:28:21 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:28:21 user nova-compute[76391]:   </cpu>
Nov 15 23:28:21 user nova-compute[76391]:   <devices>
Nov 15 23:28:21 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:28:21 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:28:21 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk"/>
Nov 15 23:28:21 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:28:21 user nova-compute[76391]:     </disk>
Nov 15 23:28:21 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:28:21 user nova-compute[76391]:       <mac address="fa:16:3e:f6:0a:91"/>
Nov 15 23:28:21 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:28:21 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:28:21 user nova-compute[76391]:       <target dev="tap6242d910-98"/>
Nov 15 23:28:21 user nova-compute[76391]:     </interface>
Nov 15 23:28:21 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:28:21 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/console.log" append="off"/>
Nov 15 23:28:21 user nova-compute[76391]:     </serial>
Nov 15 23:28:21 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:28:21 user nova-compute[76391]:     <video>
Nov 15 23:28:21 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:28:21 user nova-compute[76391]:     </video>
Nov 15 23:28:21 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:28:21 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:28:21 user nova-compute[76391]:     </rng>
Nov 15 23:28:21 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:28:21 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:28:21 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:28:21 user nova-compute[76391]:     </memballoon>
Nov 15 23:28:21 user nova-compute[76391]:   </devices>
Nov 15 23:28:21 user nova-compute[76391]: </domain>
Nov 15 23:28:21 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1384069568',display_name='tempest-TestMinimumBasicScenario-server-1384069568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1384069568',id=36,image_ref='475afe99-564c-47e9-a7f3-1316f0fbdc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1NJSHD042FhzQbQPREnPE2/S6iDbzKlj7Z78M6S+vpwCWtPfnO+/nlK/lh/apXWW4MLqWbCq4xUV8ThzpZUbxRxSqoOJh34r3WCTJyB3wsND3oHv1BniuTvkWC5zT/Pw==',key_name='tempest-TestMinimumBasicScenario-661759224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-uftdiewc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='475afe99-564c-47e9-a7f3-1316f0fbdc78',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:20Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=745360bd-e3db-4960-870a-ea1889afff5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=6242d910-98a4-4458-90fa-b4ad2bc9d3f3,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6242d910-98') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG os_vif [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=6242d910-98a4-4458-90fa-b4ad2bc9d3f3,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6242d910-98') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3fa003c-5003-5ce3-829e-ab2e09da8fab', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6242d910-98, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6242d910-98, col_values=(('qos', UUID('6d149970-ad66-48f0-9119-be61da376a8e')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6242d910-98, col_values=(('external_ids', {'iface-id': '6242d910-98a4-4458-90fa-b4ad2bc9d3f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:0a:91', 'vm-uuid': '745360bd-e3db-4960-870a-ea1889afff5a'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:21 user nova-compute[76391]: INFO os_vif [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=6242d910-98a4-4458-90fa-b4ad2bc9d3f3,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6242d910-98')
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No VIF found with MAC fa:16:3e:f6:0a:91, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.neutron [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updated VIF entry in instance network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG nova.network.neutron [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cb2b9e1c-ffab-442b-b418-da41405a3aa4 req-ca26ff4d-e792-4e0f-9f2e-8b8c46fa5589 service nova] Releasing lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1555b3df-63ec-4803-8a95-84c35e9e7786 req-767a4b56-1487-4100-836f-c843e7b8cf16 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1555b3df-63ec-4803-8a95-84c35e9e7786 req-767a4b56-1487-4100-836f-c843e7b8cf16 service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1555b3df-63ec-4803-8a95-84c35e9e7786 req-767a4b56-1487-4100-836f-c843e7b8cf16 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1555b3df-63ec-4803-8a95-84c35e9e7786 req-767a4b56-1487-4100-836f-c843e7b8cf16 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-1555b3df-63ec-4803-8a95-84c35e9e7786 req-767a4b56-1487-4100-836f-c843e7b8cf16 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:23 user nova-compute[76391]: WARNING nova.compute.manager [req-1555b3df-63ec-4803-8a95-84c35e9e7786 req-767a4b56-1487-4100-836f-c843e7b8cf16 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state building and task_state spawning.
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-73a99d9b-9bda-46ec-8308-de4df9c9d8ac req-7efdd87e-b2dd-41ab-89ee-64412803502e service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-73a99d9b-9bda-46ec-8308-de4df9c9d8ac req-7efdd87e-b2dd-41ab-89ee-64412803502e service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-73a99d9b-9bda-46ec-8308-de4df9c9d8ac req-7efdd87e-b2dd-41ab-89ee-64412803502e service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-73a99d9b-9bda-46ec-8308-de4df9c9d8ac req-7efdd87e-b2dd-41ab-89ee-64412803502e service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-73a99d9b-9bda-46ec-8308-de4df9c9d8ac req-7efdd87e-b2dd-41ab-89ee-64412803502e service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:25 user nova-compute[76391]: WARNING nova.compute.manager [req-73a99d9b-9bda-46ec-8308-de4df9c9d8ac req-7efdd87e-b2dd-41ab-89ee-64412803502e service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state building and task_state spawning.
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:28:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6969MB free_disk=24.94577407836914GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:25 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance spawned successfully.
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:28:26 user nova-compute[76391]: INFO nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 39b01e2d-c7e1-4fb0-a184-088120332b4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 94e6e796-afc9-4058-840d-ae77df5ffcc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5016e2a6-3131-4107-a002-37993287edce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3913ccaf-90f8-4196-bb56-3cee0547dee4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 745360bd-e3db-4960-870a-ea1889afff5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:28:26 user nova-compute[76391]: INFO nova.compute.manager [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Took 7.17 seconds to build instance.
Nov 15 23:28:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c7a987f3-004e-43a0-9342-0aab95ab8f4c tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.283s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:28:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:28:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:35 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 is timed out.
Nov 15 23:28:35 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully detached device vdc from instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 from the live domain config.
Nov 15 23:28:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mGZSbClR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:28:35 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:28:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[667f6e31-958f-4747-875e-af16853f2896]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:28:35 user nova-compute[76391]: No targets found.
Nov 15 23:28:35 user nova-compute[76391]: iSNS:
Nov 15 23:28:35 user nova-compute[76391]: No targets found.
Nov 15 23:28:35 user nova-compute[76391]: STATIC:
Nov 15 23:28:35 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:28:35 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:35 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:35 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:28:35 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:35 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:35 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:28:35 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:35 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:35 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:28:35 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:35 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:35 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484
Nov 15 23:28:35 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:35 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:35 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20
Nov 15 23:28:35 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:35 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:35 user nova-compute[76391]: FIRMWARE:
Nov 15 23:28:35 user nova-compute[76391]: No targets found.
Nov 15 23:28:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:28:35 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:28:35 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe9c2b-c022-4046-8dbc-3e5888173c86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36774509-5c9c-4aad-8468-f02a50003487]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:28:36 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97600ec940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484'): ({'sdd'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Removing single pathed devices sdd {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b78faa8-18df-410c-8034-49560d31a6d4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad75bd82-8371-4057-98fd-6c25c6d299ad]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flushing IO for device /dev/sdd {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca332fcf-be34-4246-96a0-3f8087f1edc6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3dd5b7-cd95-4ea9-841d-93d30ea4d5bd]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a549f965-97c3-44f7-9d7c-922dce570e39]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[391edf07-7b31-49ce-ae8d-8b0530729485]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260]
Nov 15 23:28:36 user nova-compute[76391]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484, portal: 172.16.0.220,3260] successful.
Nov 15 23:28:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0ca94-720e-4ca2-a4cf-2766a1523484 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfaf7aa-a671-4f94-b4c0-03b10eede2d7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] <== disconnect_volume: return (339ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:28:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:37 user nova-compute[76391]: DEBUG nova.objects.instance [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'flavor' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:28:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cdcb9ed9-1d91-4f7e-a53e-204933f0c9a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-changed-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Refreshing instance network info cache due to event network-changed-a0e36bda-f671-4e95-8488-e500b017cbb4. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:28:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] Acquiring lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] Acquired lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:42 user nova-compute[76391]: DEBUG nova.network.neutron [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Refreshing network info cache for port a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG nova.network.neutron [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updated VIF entry in instance network info cache for port a0e36bda-f671-4e95-8488-e500b017cbb4. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG nova.network.neutron [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [{"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-99a3849f-f760-4acb-90c8-5c450c2bcdc3 req-66344be3-7ad7-41ff-8b78-fdbf64e1d3d7 service nova] Releasing lock "refresh_cache-6626d0d5-79ae-433b-aa6f-94e69353c7d3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing instance network info cache due to event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:43 user nova-compute[76391]: DEBUG nova.network.neutron [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Stashing vm_state: active {{(pid=76391) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:28:44 user nova-compute[76391]: INFO nova.compute.claims [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Claim successful on node user
Nov 15 23:28:44 user nova-compute[76391]: INFO nova.compute.resource_tracker [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating resource usage from migration 9997678e-d974-4046-a075-27c9a2833dc0
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updated VIF entry in instance network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e09c282d-5448-4316-9ece-5386da602441 req-f7302b71-0e7e-42a2-9f1b-daddc6bc773e service nova] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-changed-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Refreshing instance network info cache due to event network-changed-7931f0a9-dea3-4cf1-91f4-1039b3866903. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] Acquiring lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] Acquired lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Refreshing network info cache for port 7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:44 user nova-compute[76391]: INFO nova.compute.manager [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Shelve offloading
Nov 15 23:28:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.648s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:44 user nova-compute[76391]: INFO nova.compute.manager [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Migrating
Nov 15 23:28:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updated VIF entry in instance network info cache for port 7931f0a9-dea3-4cf1-91f4-1039b3866903. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:45 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance destroyed successfully.
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3fa54715-148b-4bed-a809-d8bbeeb1fa47 req-e8fb3f4b-6fc0-4f53-be2d-abf5a295b3a8 service nova] Releasing lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquired lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:45 user nova-compute[76391]: WARNING nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state active and task_state shelving.
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:45 user nova-compute[76391]: WARNING nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state active and task_state shelving.
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:45 user nova-compute[76391]: DEBUG nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:45 user nova-compute[76391]: WARNING nova.compute.manager [req-1e05ce2c-2d8e-4291-aed8-df99e3819d60 req-34c04184-29c1-4592-a7cf-581147db89b0 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state active and task_state shelving.
Nov 15 23:28:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Releasing lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Starting migrate_disk_and_power_off {{(pid=76391) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance destroyed successfully.
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'resources' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925434621',display_name='tempest-TestShelveInstance-server-1925434621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925434621',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPrzGj1so767S6ODaoPSCzjeB6w7evmPlNZ3mvLaVmQRdlm+PESukcUE8uqVKhJOxoNqux2Ka0uJmSGp0dRzCqOIGmBzOmr8W8xGgQEr59/bAS2KNhyW4h1Ix5TKr5Kkw==',key_name='tempest-TestShelveInstance-1887119281',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5db709fa12274eab9402a50013e7db5f',ramdisk_id='',reservation_id='r-ktv3zmaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2043367122',owner_user_name='tempest-TestShelveInstance-2043367122-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:27:04Z,user_data=None,user_id='44386665eb154a26b4a15de6ae2f4ebb',uuid=94e6e796-afc9-4058-840d-ae77df5ffcc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converting VIF {"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_vif [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49be1bfc-4b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=370fd859-59bc-42bc-be8f-b1bb3666e687) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: INFO os_vif [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b')
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:28:47 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[739fa843-c800-4cc1-9a31-8e5701ea0600]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:28:47 user nova-compute[76391]: No targets found.
Nov 15 23:28:47 user nova-compute[76391]: iSNS:
Nov 15 23:28:47 user nova-compute[76391]: No targets found.
Nov 15 23:28:47 user nova-compute[76391]: STATIC:
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: FIRMWARE:
Nov 15 23:28:47 user nova-compute[76391]: No targets found.
Nov 15 23:28:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:28:47 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:28:47 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b17909-e3eb-4188-a3be-8d73862570a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[38226cff-e1ee-481d-9c60-ea9726b67abf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740359870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58461399-83f4-455b-83fc-ccf46101af72]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff81f1-b28a-4a76-b132-3344359c0534]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance destroyed successfully.
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-135273876',display_name='tempest-ServerActionsTestOtherA-server-135273876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-135273876',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-x0kl6uu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e640c20f-d2d0-4b48-b13c-8ee8b1af864b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-257918397-network", "vif_mac": "fa:16:3e:b9:7e:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-257918397-network", "vif_mac": "fa:16:3e:b9:7e:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_vif [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ecb80-65d7-447a-b0f9-412a184996a2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7931f0a9-de, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=479db849-71e0-4384-b1ac-4967fc1fd650) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:47 user nova-compute[76391]: INFO os_vif [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de')
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:28:47 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca91c0c-9798-4239-975c-60f077b55571]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.071s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeef2229-0a89-4186-bb7a-51cd77414ca6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be4b7f-4ffd-498f-a75f-657efa0cd8c4]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]
Nov 15 23:28:47 user nova-compute[76391]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.
Nov 15 23:28:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c946fd-21c3-47ef-a753-e090a6bfd67a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] <== disconnect_volume: return (471ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:28:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Deleting instance files /opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3_del
Nov 15 23:28:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Deletion of /opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3_del complete
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.276s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ef2997-7088-45ce-b8f8-8d957953830c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:28:47 user nova-compute[76391]: No targets found.
Nov 15 23:28:47 user nova-compute[76391]: iSNS:
Nov 15 23:28:47 user nova-compute[76391]: No targets found.
Nov 15 23:28:47 user nova-compute[76391]: STATIC:
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:28:47 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:28:47 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:28:47 user nova-compute[76391]: FIRMWARE:
Nov 15 23:28:47 user nova-compute[76391]: No targets found.
Nov 15 23:28:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:28:47 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:28:47 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7318375-5f3a-4909-8b58-a6a762b2056f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767277e-7e63-4551-851d-c9e247d0f298]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:47 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405a2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8'): ({'sde'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Removing single pathed devices sde {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1695cb30-6fc4-4cdc-b706-8bd67ac4f5de]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87315d95-6045-4379-90d3-8b79a564b3da]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flushing IO for device /dev/sde {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06700a43-9f69-4a76-934b-82e06d0d8c3f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c42728-0abc-48f0-a833-1e5541662c00]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a18cc6-0d1e-498a-8cc5-45f6b62d32ed]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0dbdfc-32a6-4915-a661-e40301b0ed69]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]
Nov 15 23:28:48 user nova-compute[76391]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.
Nov 15 23:28:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:48 user nova-compute[76391]: WARNING nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state active and task_state shelving.
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:48 user nova-compute[76391]: WARNING nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state active and task_state shelving.
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:48 user nova-compute[76391]: WARNING nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state active and task_state shelving.
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing instance network info cache due to event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7e5d9a-8083-41b1-ae5f-bb2471d560ae]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== disconnect_volume: return (582ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:48 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Deleted allocations for instance 94e6e796-afc9-4058-840d-ae77df5ffcc3
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.objects.instance [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'numa_topology' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:28:48 user nova-compute[76391]: DEBUG nova.objects.base [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Object Instance<94e6e796-afc9-4058-840d-ae77df5ffcc3> lazy-loaded attributes: resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.network.neutron [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updated VIF entry in instance network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.network.neutron [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": null, "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-445645ca-9188-4dba-a383-2493018a6e99 req-44461d95-573d-4c91-b3ec-fa8ba4a3a15d service nova] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Port 7931f0a9-dea3-4cf1-91f4-1039b3866903 binding to destination host user is already ACTIVE {{(pid=76391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-854e0334-53be-4e41-9978-6de92777a7ff req-dd187e87-6865-494d-94e9-c7ca6f812a83 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-unplugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-854e0334-53be-4e41-9978-6de92777a7ff req-dd187e87-6865-494d-94e9-c7ca6f812a83 service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-854e0334-53be-4e41-9978-6de92777a7ff req-dd187e87-6865-494d-94e9-c7ca6f812a83 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-854e0334-53be-4e41-9978-6de92777a7ff req-dd187e87-6865-494d-94e9-c7ca6f812a83 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-854e0334-53be-4e41-9978-6de92777a7ff req-dd187e87-6865-494d-94e9-c7ca6f812a83 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-unplugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:49 user nova-compute[76391]: WARNING nova.compute.manager [req-854e0334-53be-4e41-9978-6de92777a7ff req-dd187e87-6865-494d-94e9-c7ca6f812a83 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received unexpected event network-vif-unplugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with vm_state active and task_state resize_migrating.
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4d00ab6f-31a5-4d82-bef3-cc85ae3705ed tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.816s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquired lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:49 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG nova.network.neutron [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Releasing lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG os_brick.utils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2a171-d199-401c-9d8c-057fc2e7a0d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed693b68-28a1-4e3b-8bfe-94e96a4939ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5887539-7e59-43c0-8713-2a1598302892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e7aec1-351a-4fca-afaa-e353b3d7767c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:28:50 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:28:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3568a2a-d24d-4ffb-a70a-8bb4d570deb0]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG os_brick.utils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:28:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-74fc4bf5-5ca6-4660-9ed6-a32238905d82 req-ad77385a-a319-4f2c-9c07-3ff8deb9b64e service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-74fc4bf5-5ca6-4660-9ed6-a32238905d82 req-ad77385a-a319-4f2c-9c07-3ff8deb9b64e service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-74fc4bf5-5ca6-4660-9ed6-a32238905d82 req-ad77385a-a319-4f2c-9c07-3ff8deb9b64e service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-74fc4bf5-5ca6-4660-9ed6-a32238905d82 req-ad77385a-a319-4f2c-9c07-3ff8deb9b64e service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-74fc4bf5-5ca6-4660-9ed6-a32238905d82 req-ad77385a-a319-4f2c-9c07-3ff8deb9b64e service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:51 user nova-compute[76391]: WARNING nova.compute.manager [req-74fc4bf5-5ca6-4660-9ed6-a32238905d82 req-ad77385a-a319-4f2c-9c07-3ff8deb9b64e service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received unexpected event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with vm_state active and task_state resize_finish.
Nov 15 23:28:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:28:53 user nova-compute[76391]: INFO nova.compute.claims [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Claim successful on node user
Nov 15 23:28:53 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:28:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.policy [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a528d0d051842a5882c42869a100837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913d851a2447440ca19ff9134580033c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:28:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Creating image(s)
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "/opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "/opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "/opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk 1073741824" returned: 0 in 0.046s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.network.neutron [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Successfully created port: 6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Cannot resize image /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Ensure instance console log exists: /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.neutron [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Successfully updated port: 6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquired lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.neutron [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-changed-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Refreshing instance network info cache due to event network-changed-6969b61a-3736-4393-935f-aa33cf7d4b1f. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] Acquiring lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.neutron [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Starting finish_migration {{(pid=76391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:28:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Creating image(s)
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Ensure instance console log exists: /opt/stack/data/nova/instances/e640c20f-d2d0-4b48-b13c-8ee8b1af864b/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Start _get_guest_xml network_info=[{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-257918397-network", "vif_mac": "fa:16:3e:b9:7e:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e640c20f-d2d0-4b48-b13c-8ee8b1af864b', 'attached_at': '2023-11-15T23:28:55.000000', 'detached_at': '', 'volume_id': '992b1ee7-6005-4918-9607-f77d35383bc8', 'serial': '992b1ee7-6005-4918-9607-f77d35383bc8'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '4a454e67-bca2-4517-8333-4f49038c9301', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:28:55 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:55 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:28:55 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:28:55 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:28:55 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e332f4ce-e897-4016-a036-06e34d8f32dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:28:55 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaef9b5-e6ce-4409-a376-fa32451ae1df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8] added
Nov 15 23:28:55 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4d77f4-5263-4f25-b179-a0f7f8088294]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18165994-21ee-4adf-8a05-b9a41c5ff797]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOUtySWA {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOUtySWA" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35186d02-995e-4ded-8dab-6d8b75b4b329]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FOUtySWA'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc62357-5fa4-4766-9e6c-c740ce718e61]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73b5e28-0d33-461c-942f-715c4eaced21]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:55 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:55 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.neutron [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updating instance_info_cache with network_info: [{"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Releasing lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Instance network_info: |[{"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] Acquired lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.neutron [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Refreshing network info cache for port 6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Start _get_guest_xml network_info=[{"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0770bb19-7061-49b0-84f4-e50a45069f07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]
Nov 15 23:28:55 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.
Nov 15 23:28:55 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:55 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-815542623',display_name='tempest-TestServerVolumeAttachmentScenario-server-815542623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-815542623',id=37,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw2eZGycZBoYWWAHaZ8hllmO/gH2iD+y8qlbfuWNXRrQuXDjWaXgHRHicZMhhsGy72Kf2R3zI+R9eIEIFekyy40C/Xnq1no13UHR2d96PJ5yLXBdE6KWAqPR93W2PkwNg==',key_name='tempest-keypair-1597731779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='913d851a2447440ca19ff9134580033c',ramdisk_id='',reservation_id='r-pix34opv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2119127060',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2119127060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a528d0d051842a5882c42869a100837',uuid=63907be3-2f2f-4d5f-921d-20020c1a018b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Converting VIF {"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:70:3c,bridge_name='br-int',has_traffic_filtering=True,id=6969b61a-3736-4393-935f-aa33cf7d4b1f,network=Network(70f33554-9ad8-4e43-ae8f-8698588862df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6969b61a-37') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.objects.instance [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'pci_devices' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[df60a890-90bf-431c-8b18-5bd55475f7b5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:28:55 user nova-compute[76391]:   <uuid>63907be3-2f2f-4d5f-921d-20020c1a018b</uuid>
Nov 15 23:28:55 user nova-compute[76391]:   <name>instance-00000025</name>
Nov 15 23:28:55 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:28:55 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:28:55 user nova-compute[76391]:   <metadata>
Nov 15 23:28:55 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:28:55 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:28:55 user nova-compute[76391]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-815542623</nova:name>
Nov 15 23:28:55 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:28:55</nova:creationTime>
Nov 15 23:28:55 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:28:55 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:28:55 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:28:55 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:28:55 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:28:55 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:28:55 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:28:55 user nova-compute[76391]:       <nova:owner>
Nov 15 23:28:55 user nova-compute[76391]:         <nova:user uuid="9a528d0d051842a5882c42869a100837">tempest-TestServerVolumeAttachmentScenario-2119127060-project-member</nova:user>
Nov 15 23:28:55 user nova-compute[76391]:         <nova:project uuid="913d851a2447440ca19ff9134580033c">tempest-TestServerVolumeAttachmentScenario-2119127060</nova:project>
Nov 15 23:28:55 user nova-compute[76391]:       </nova:owner>
Nov 15 23:28:55 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:28:55 user nova-compute[76391]:       <nova:ports>
Nov 15 23:28:55 user nova-compute[76391]:         <nova:port uuid="6969b61a-3736-4393-935f-aa33cf7d4b1f">
Nov 15 23:28:55 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 23:28:55 user nova-compute[76391]:         </nova:port>
Nov 15 23:28:55 user nova-compute[76391]:       </nova:ports>
Nov 15 23:28:55 user nova-compute[76391]:     </nova:instance>
Nov 15 23:28:55 user nova-compute[76391]:   </metadata>
Nov 15 23:28:55 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:28:55 user nova-compute[76391]:     <system>
Nov 15 23:28:55 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:28:55 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:28:55 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:28:55 user nova-compute[76391]:       <entry name="serial">63907be3-2f2f-4d5f-921d-20020c1a018b</entry>
Nov 15 23:28:55 user nova-compute[76391]:       <entry name="uuid">63907be3-2f2f-4d5f-921d-20020c1a018b</entry>
Nov 15 23:28:55 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:28:55 user nova-compute[76391]:     </system>
Nov 15 23:28:55 user nova-compute[76391]:   </sysinfo>
Nov 15 23:28:55 user nova-compute[76391]:   <os>
Nov 15 23:28:55 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:28:55 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:28:55 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:28:55 user nova-compute[76391]:   </os>
Nov 15 23:28:55 user nova-compute[76391]:   <features>
Nov 15 23:28:55 user nova-compute[76391]:     <acpi/>
Nov 15 23:28:55 user nova-compute[76391]:     <apic/>
Nov 15 23:28:55 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:28:55 user nova-compute[76391]:   </features>
Nov 15 23:28:55 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:28:55 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:28:55 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:28:55 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:28:55 user nova-compute[76391]:   </clock>
Nov 15 23:28:55 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:28:55 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:28:55 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:28:55 user nova-compute[76391]:   </cpu>
Nov 15 23:28:55 user nova-compute[76391]:   <devices>
Nov 15 23:28:55 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:28:55 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:28:55 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk"/>
Nov 15 23:28:55 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:28:55 user nova-compute[76391]:     </disk>
Nov 15 23:28:55 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:28:55 user nova-compute[76391]:       <mac address="fa:16:3e:10:70:3c"/>
Nov 15 23:28:55 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:28:55 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:28:55 user nova-compute[76391]:       <target dev="tap6969b61a-37"/>
Nov 15 23:28:55 user nova-compute[76391]:     </interface>
Nov 15 23:28:55 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:28:55 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/console.log" append="off"/>
Nov 15 23:28:55 user nova-compute[76391]:     </serial>
Nov 15 23:28:55 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:28:55 user nova-compute[76391]:     <video>
Nov 15 23:28:55 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:28:55 user nova-compute[76391]:     </video>
Nov 15 23:28:55 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:28:55 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:28:55 user nova-compute[76391]:     </rng>
Nov 15 23:28:55 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:28:55 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:28:55 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:28:55 user nova-compute[76391]:     </memballoon>
Nov 15 23:28:55 user nova-compute[76391]:   </devices>
Nov 15 23:28:55 user nova-compute[76391]: </domain>
Nov 15 23:28:55 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-815542623',display_name='tempest-TestServerVolumeAttachmentScenario-server-815542623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-815542623',id=37,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw2eZGycZBoYWWAHaZ8hllmO/gH2iD+y8qlbfuWNXRrQuXDjWaXgHRHicZMhhsGy72Kf2R3zI+R9eIEIFekyy40C/Xnq1no13UHR2d96PJ5yLXBdE6KWAqPR93W2PkwNg==',key_name='tempest-keypair-1597731779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='913d851a2447440ca19ff9134580033c',ramdisk_id='',reservation_id='r-pix34opv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2119127060',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2119127060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a528d0d051842a5882c42869a100837',uuid=63907be3-2f2f-4d5f-921d-20020c1a018b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Converting VIF {"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:70:3c,bridge_name='br-int',has_traffic_filtering=True,id=6969b61a-3736-4393-935f-aa33cf7d4b1f,network=Network(70f33554-9ad8-4e43-ae8f-8698588862df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6969b61a-37') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_vif [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:70:3c,bridge_name='br-int',has_traffic_filtering=True,id=6969b61a-3736-4393-935f-aa33cf7d4b1f,network=Network(70f33554-9ad8-4e43-ae8f-8698588862df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6969b61a-37') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6379ce8-61a8-5265-b3c9-2e125c0ae11b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed1082b-7c13-4c05-b104-3df99ebc39f1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:55 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:28:55 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:28:55 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6969b61a-37, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6969b61a-37, col_values=(('qos', UUID('b4d019df-5803-451a-9461-8f58abe9e256')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6969b61a-37, col_values=(('external_ids', {'iface-id': '6969b61a-3736-4393-935f-aa33cf7d4b1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:70:3c', 'vm-uuid': '63907be3-2f2f-4d5f-921d-20020c1a018b'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:55 user nova-compute[76391]: INFO os_vif [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:70:3c,bridge_name='br-int',has_traffic_filtering=True,id=6969b61a-3736-4393-935f-aa33cf7d4b1f,network=Network(70f33554-9ad8-4e43-ae8f-8698588862df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6969b61a-37')
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78bbcd5-c722-4c01-812f-f3af2892169b]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:28:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No VIF found with MAC fa:16:3e:10:70:3c, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.network.neutron [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updated VIF entry in instance network info cache for port 6969b61a-3736-4393-935f-aa33cf7d4b1f. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.network.neutron [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updating instance_info_cache with network_info: [{"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ee9b61a5-8b54-4783-a633-d2ad802459e9 req-35bacf99-493c-47d6-9e27-de0b7a60b305 service nova] Releasing lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23432646363336331', 'path': '/dev/sdd'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432646363336331', 'path': '/dev/sdd'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-135273876',display_name='tempest-ServerActionsTestOtherA-server-135273876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-135273876',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-x0kl6uu5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e640c20f-d2d0-4b48-b13c-8ee8b1af864b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-257918397-network", "vif_mac": "fa:16:3e:b9:7e:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-257918397-network", "vif_mac": "fa:16:3e:b9:7e:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:28:56 user nova-compute[76391]:   <uuid>e640c20f-d2d0-4b48-b13c-8ee8b1af864b</uuid>
Nov 15 23:28:56 user nova-compute[76391]:   <name>instance-0000001f</name>
Nov 15 23:28:56 user nova-compute[76391]:   <memory>2097152</memory>
Nov 15 23:28:56 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:28:56 user nova-compute[76391]:   <metadata>
Nov 15 23:28:56 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:28:56 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:28:56 user nova-compute[76391]:       <nova:name>tempest-ServerActionsTestOtherA-server-135273876</nova:name>
Nov 15 23:28:56 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:28:55</nova:creationTime>
Nov 15 23:28:56 user nova-compute[76391]:       <nova:flavor name="m1.small">
Nov 15 23:28:56 user nova-compute[76391]:         <nova:memory>2048</nova:memory>
Nov 15 23:28:56 user nova-compute[76391]:         <nova:disk>20</nova:disk>
Nov 15 23:28:56 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:28:56 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:28:56 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:28:56 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:28:56 user nova-compute[76391]:       <nova:owner>
Nov 15 23:28:56 user nova-compute[76391]:         <nova:user uuid="c9170a4bb51b41d289416bb371c98a3b">tempest-ServerActionsTestOtherA-1370446029-project-member</nova:user>
Nov 15 23:28:56 user nova-compute[76391]:         <nova:project uuid="472379097b584f5da5aa8f5c919f2e82">tempest-ServerActionsTestOtherA-1370446029</nova:project>
Nov 15 23:28:56 user nova-compute[76391]:       </nova:owner>
Nov 15 23:28:56 user nova-compute[76391]:       <nova:ports>
Nov 15 23:28:56 user nova-compute[76391]:         <nova:port uuid="7931f0a9-dea3-4cf1-91f4-1039b3866903">
Nov 15 23:28:56 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 23:28:56 user nova-compute[76391]:         </nova:port>
Nov 15 23:28:56 user nova-compute[76391]:       </nova:ports>
Nov 15 23:28:56 user nova-compute[76391]:     </nova:instance>
Nov 15 23:28:56 user nova-compute[76391]:   </metadata>
Nov 15 23:28:56 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:28:56 user nova-compute[76391]:     <system>
Nov 15 23:28:56 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:28:56 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:28:56 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:28:56 user nova-compute[76391]:       <entry name="serial">e640c20f-d2d0-4b48-b13c-8ee8b1af864b</entry>
Nov 15 23:28:56 user nova-compute[76391]:       <entry name="uuid">e640c20f-d2d0-4b48-b13c-8ee8b1af864b</entry>
Nov 15 23:28:56 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:28:56 user nova-compute[76391]:     </system>
Nov 15 23:28:56 user nova-compute[76391]:   </sysinfo>
Nov 15 23:28:56 user nova-compute[76391]:   <os>
Nov 15 23:28:56 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:28:56 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:28:56 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:28:56 user nova-compute[76391]:   </os>
Nov 15 23:28:56 user nova-compute[76391]:   <features>
Nov 15 23:28:56 user nova-compute[76391]:     <acpi/>
Nov 15 23:28:56 user nova-compute[76391]:     <apic/>
Nov 15 23:28:56 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:28:56 user nova-compute[76391]:   </features>
Nov 15 23:28:56 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:28:56 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:28:56 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:28:56 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:28:56 user nova-compute[76391]:   </clock>
Nov 15 23:28:56 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:28:56 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:28:56 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:28:56 user nova-compute[76391]:   </cpu>
Nov 15 23:28:56 user nova-compute[76391]:   <devices>
Nov 15 23:28:56 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:28:56 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:28:56 user nova-compute[76391]:       <source dev="/dev/sdd"/>
Nov 15 23:28:56 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:28:56 user nova-compute[76391]:       <serial>992b1ee7-6005-4918-9607-f77d35383bc8</serial>
Nov 15 23:28:56 user nova-compute[76391]:     </disk>
Nov 15 23:28:56 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:28:56 user nova-compute[76391]:       <mac address="fa:16:3e:b9:7e:a0"/>
Nov 15 23:28:56 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:28:56 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:28:56 user nova-compute[76391]:       <target dev="tap7931f0a9-de"/>
Nov 15 23:28:56 user nova-compute[76391]:     </interface>
Nov 15 23:28:56 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:28:56 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/e640c20f-d2d0-4b48-b13c-8ee8b1af864b/console.log" append="off"/>
Nov 15 23:28:56 user nova-compute[76391]:     </serial>
Nov 15 23:28:56 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:28:56 user nova-compute[76391]:     <video>
Nov 15 23:28:56 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:28:56 user nova-compute[76391]:     </video>
Nov 15 23:28:56 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:28:56 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:28:56 user nova-compute[76391]:     </rng>
Nov 15 23:28:56 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:28:56 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:28:56 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:28:56 user nova-compute[76391]:     </memballoon>
Nov 15 23:28:56 user nova-compute[76391]:   </devices>
Nov 15 23:28:56 user nova-compute[76391]: </domain>
Nov 15 23:28:56 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-135273876',display_name='tempest-ServerActionsTestOtherA-server-135273876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-135273876',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-x0kl6uu5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e640c20f-d2d0-4b48-b13c-8ee8b1af864b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-257918397-network", "vif_mac": "fa:16:3e:b9:7e:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-257918397-network", "vif_mac": "fa:16:3e:b9:7e:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG os_vif [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be9b64d8-31d0-5749-be13-b7168b0c762b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7931f0a9-de, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7931f0a9-de, col_values=(('qos', UUID('ea91ad4d-d68d-44d5-9d3e-3447e5394062')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7931f0a9-de, col_values=(('external_ids', {'iface-id': '7931f0a9-dea3-4cf1-91f4-1039b3866903', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:7e:a0', 'vm-uuid': 'e640c20f-d2d0-4b48-b13c-8ee8b1af864b'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:56 user nova-compute[76391]: INFO os_vif [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de')
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:28:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] No VIF found with MAC fa:16:3e:b9:7e:a0, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8e19acbe-1f64-45f2-ae58-5289f2f69d94 req-81df6adf-495a-4cbb-94d3-22c08abc9e7f service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8e19acbe-1f64-45f2-ae58-5289f2f69d94 req-81df6adf-495a-4cbb-94d3-22c08abc9e7f service nova] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8e19acbe-1f64-45f2-ae58-5289f2f69d94 req-81df6adf-495a-4cbb-94d3-22c08abc9e7f service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8e19acbe-1f64-45f2-ae58-5289f2f69d94 req-81df6adf-495a-4cbb-94d3-22c08abc9e7f service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8e19acbe-1f64-45f2-ae58-5289f2f69d94 req-81df6adf-495a-4cbb-94d3-22c08abc9e7f service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] No waiting events found dispatching network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:57 user nova-compute[76391]: WARNING nova.compute.manager [req-8e19acbe-1f64-45f2-ae58-5289f2f69d94 req-81df6adf-495a-4cbb-94d3-22c08abc9e7f service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received unexpected event network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f for instance with vm_state building and task_state spawning.
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] No waiting events found dispatching network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:59 user nova-compute[76391]: WARNING nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received unexpected event network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f for instance with vm_state building and task_state spawning.
Nov 15 23:28:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:59 user nova-compute[76391]: WARNING nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received unexpected event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with vm_state active and task_state resize_finish.
Nov 15 23:28:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:28:59 user nova-compute[76391]: WARNING nova.compute.manager [req-4cadbfae-6573-450a-897b-b6c75cf21870 req-ce23874e-3af3-4643-9109-ab81e10fb8e9 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received unexpected event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with vm_state active and task_state resize_finish.
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:28:59 user nova-compute[76391]: INFO nova.compute.manager [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Terminating instance
Nov 15 23:28:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:28:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Instance destroyed successfully.
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.objects.instance [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lazy-loading 'resources' on Instance uuid 39b01e2d-c7e1-4fb0-a184-088120332b4f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1479706453',display_name='tempest-ServerActionsTestOtherB-server-1479706453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1479706453',id=22,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwROBFDCeWrN33k+4MA+VxCbCws4mxExn6zF0Ghq5kMCn5iVAz4YhKl4oFSuMLYF3ZhOv6bCxbQ/AlB2vI7M53us+MBmImEVeCPSWLt7Wd/wfp72WgyaJjrwu3zkIaAUQ==',key_name='tempest-keypair-837842051',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:26:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ad6f3dde3a4b8b9a78f79cebabd970',ramdisk_id='',reservation_id='r-1ddgksdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-518662408',owner_user_name='tempest-ServerActionsTestOtherB-518662408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:26:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a246bfc3bf184459b37f06965c15b77b',uuid=39b01e2d-c7e1-4fb0-a184-088120332b4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converting VIF {"id": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "address": "fa:16:3e:0c:74:2a", "network": {"id": "9aeab8f1-d592-4060-a348-9ef7e0a30791", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047332978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ad6f3dde3a4b8b9a78f79cebabd970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e3d304-aa", "ovs_interfaceid": "f6e3d304-aa96-4149-9ea5-9fb21f718c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_vif [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6e3d304-aa, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31404b53-b206-4c20-a31e-ff9869ee7f4f) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:00 user nova-compute[76391]: INFO os_vif [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:74:2a,bridge_name='br-int',has_traffic_filtering=True,id=f6e3d304-aa96-4149-9ea5-9fb21f718c1c,network=Network(9aeab8f1-d592-4060-a348-9ef7e0a30791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6e3d304-aa')
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THVEqGil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:29:00 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f4f21-26ac-46d2-94de-108fe3a53b97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:29:00 user nova-compute[76391]: No targets found.
Nov 15 23:29:00 user nova-compute[76391]: iSNS:
Nov 15 23:29:00 user nova-compute[76391]: No targets found.
Nov 15 23:29:00 user nova-compute[76391]: STATIC:
Nov 15 23:29:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:29:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:29:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:29:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651
Nov 15 23:29:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:00 user nova-compute[76391]: FIRMWARE:
Nov 15 23:29:00 user nova-compute[76391]: No targets found.
Nov 15 23:29:00 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:29:00 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:29:00 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9c1758-29f8-4e7a-9407-8b175554c878]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[717edc8f-3b62-4a29-a2d5-0f56341553f2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:00 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:29:00 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:00 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:00 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:00 user nova-compute[76391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 (non-flash)
Nov 15 23:29:00 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:00 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:00 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976038b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:29:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance running successfully.
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Instance spawned successfully.
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Failed to set time: agent not configured {{(pid=76391) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b97258d4-3bf4-45e3-9932-151e3b8fcdf0 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] finish_migration finished successfully. {{(pid=76391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd3baaf-f9f2-4c6f-8fcc-0c065585408b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe3b90-fcab-4692-a899-4e065c578dd7]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6ad0d2-ae2a-4e92-a24b-3e9092bdfeb0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: INFO nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 15 23:29:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e70fe-2a0f-4383-8ee7-f43dc37c58e3]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed5f8f-f5a3-4ff7-b4a0-87d765d5fda9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:01 user nova-compute[76391]: INFO nova.compute.manager [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Took 7.62 seconds to build instance.
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7a934-b1cb-4275-841c-04afbb6634ec]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260]
Nov 15 23:29:01 user nova-compute[76391]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651, portal: 172.16.0.220,3260] successful.
Nov 15 23:29:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-705aedf0-a93b-4d47-9c9c-8a3e9bd87415 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.744s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233f5b0c-3031-473f-b106-34585ff7c651 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c090e9-c67f-444b-ba43-043c35966284]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] <== disconnect_volume: return (356ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:29:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Deleting instance files /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f_del
Nov 15 23:29:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Deletion of /opt/stack/data/nova/instances/39b01e2d-c7e1-4fb0-a184-088120332b4f_del complete
Nov 15 23:29:01 user nova-compute[76391]: INFO nova.compute.manager [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-unplugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Acquiring lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] No waiting events found dispatching network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:01 user nova-compute[76391]: WARNING nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received unexpected event network-vif-plugged-f6e3d304-aa96-4149-9ea5-9fb21f718c1c for instance with vm_state active and task_state deleting.
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-changed-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Refreshing instance network info cache due to event network-changed-31e0f523-8bd5-48b0-987d-1cd9c5901579. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Acquiring lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Acquired lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:29:01 user nova-compute[76391]: DEBUG nova.network.neutron [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Refreshing network info cache for port 31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:29:02 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:02 user nova-compute[76391]: DEBUG nova.network.neutron [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updated VIF entry in instance network info cache for port 31e0f523-8bd5-48b0-987d-1cd9c5901579. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:29:02 user nova-compute[76391]: DEBUG nova.network.neutron [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updating instance_info_cache with network_info: [{"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:02 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Took 1.43 seconds to deallocate network for instance.
Nov 15 23:29:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bba3c2b6-b2a3-48e3-b950-93d63324230a req-cb99e4ef-f32f-40d4-b00f-43fb33535828 service nova] Releasing lock "refresh_cache-5016e2a6-3131-4107-a002-37993287edce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:29:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-b5d5ecfd-db33-4893-bcae-ededc48deaf3 req-d676b637-a2a4-475b-8968-0504307c79d6 service nova] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Received event network-vif-deleted-f6e3d304-aa96-4149-9ea5-9fb21f718c1c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:03 user nova-compute[76391]: INFO nova.compute.manager [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] [instance: 39b01e2d-c7e1-4fb0-a184-088120332b4f] Took 1.01 seconds to detach 1 volumes for instance.
Nov 15 23:29:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:03 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid 5016e2a6-3131-4107-a002-37993287edce {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:04 user nova-compute[76391]: INFO nova.compute.manager [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Attaching volume e9a39bf3-5428-4719-93ba-787cba61f226 to /dev/vdb
Nov 15 23:29:04 user nova-compute[76391]: DEBUG os_brick.utils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c89355-eb44-4c90-89ef-282e09d502a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee1bc0-3e92-4f12-9fa1-f883cafb3d28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[693bce44-7db9-4f4d-8344-436e9554e0d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72ade50-3553-45b3-af8d-8b9f08e5daa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:29:04 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fcffde-1afa-4bee-9319-8b0c9015ebe4]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG os_brick.utils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:29:04 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updating existing volume attachment record: 9017b133-689a-42f4-a3b2-07323dad16ec {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:29:04 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Deleted allocations for instance 39b01e2d-c7e1-4fb0-a184-088120332b4f
Nov 15 23:29:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bc704111-ef3c-4731-af97-8782e90161a4 tempest-ServerActionsTestOtherB-518662408 tempest-ServerActionsTestOtherB-518662408-project-member] Lock "39b01e2d-c7e1-4fb0-a184-088120332b4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.567s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:05 user nova-compute[76391]: INFO nova.compute.manager [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Terminating instance
Nov 15 23:29:05 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-6d8ad449-632d-4f2a-9ab4-982d7e39c516 req-6dc477c0-7140-4994-bab9-f732020e4b36 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-unplugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6d8ad449-632d-4f2a-9ab4-982d7e39c516 req-6dc477c0-7140-4994-bab9-f732020e4b36 service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6d8ad449-632d-4f2a-9ab4-982d7e39c516 req-6dc477c0-7140-4994-bab9-f732020e4b36 service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6d8ad449-632d-4f2a-9ab4-982d7e39c516 req-6dc477c0-7140-4994-bab9-f732020e4b36 service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-6d8ad449-632d-4f2a-9ab4-982d7e39c516 req-6dc477c0-7140-4994-bab9-f732020e4b36 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-unplugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-6d8ad449-632d-4f2a-9ab4-982d7e39c516 req-6dc477c0-7140-4994-bab9-f732020e4b36 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-unplugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:29:06 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Instance destroyed successfully.
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.objects.instance [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'resources' on Instance uuid 3045f654-72f4-44c7-bc80-92b1b9e549a8 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2092280647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2092280647',id=27,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUfeIkqisYhJfDtDT/7g9I/OkuxJxv/EWwZ+2KZOpmptwDdYd6iM/Tw9D5nSueupq99xMX7+T4pF4KMTFkJwL9pdjZYmqjAfPJifWRtQUFOuRUPTvsel158nyKFd1YQZg==',key_name='tempest-keypair-1514669977',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:26:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-sqngh7cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=3045f654-72f4-44c7-bc80-92b1b9e549a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "8acb3576-ff3c-4297-9fd7-ee981710af13", "address": "fa:16:3e:c2:32:9c", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8acb3576-ff", "ovs_interfaceid": "8acb3576-ff3c-4297-9fd7-ee981710af13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG os_vif [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8acb3576-ff, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=893b57a3-3ce0-4da3-8275-ffbf93a65e1a) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:06 user nova-compute[76391]: INFO os_vif [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:32:9c,bridge_name='br-int',has_traffic_filtering=True,id=8acb3576-ff3c-4297-9fd7-ee981710af13,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8acb3576-ff')
Nov 15 23:29:06 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Deleting instance files /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8_del
Nov 15 23:29:06 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Deletion of /opt/stack/data/nova/instances/3045f654-72f4-44c7-bc80-92b1b9e549a8_del complete
Nov 15 23:29:06 user nova-compute[76391]: INFO nova.compute.manager [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 23:29:06 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:29:06 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:29:07 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-1608bfd6-7e50-4a50-af33-d9011056ee6e req-7b9782b3-65de-4306-b84b-eabf35026dd1 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-deleted-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:07 user nova-compute[76391]: INFO nova.compute.manager [req-1608bfd6-7e50-4a50-af33-d9011056ee6e req-7b9782b3-65de-4306-b84b-eabf35026dd1 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Neutron deleted interface 8acb3576-ff3c-4297-9fd7-ee981710af13; detaching it from the instance and deleting it from the info cache
Nov 15 23:29:07 user nova-compute[76391]: DEBUG nova.network.neutron [req-1608bfd6-7e50-4a50-af33-d9011056ee6e req-7b9782b3-65de-4306-b84b-eabf35026dd1 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:07 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Took 0.85 seconds to deallocate network for instance.
Nov 15 23:29:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-1608bfd6-7e50-4a50-af33-d9011056ee6e req-7b9782b3-65de-4306-b84b-eabf35026dd1 service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Detach interface failed, port_id=8acb3576-ff3c-4297-9fd7-ee981710af13, reason: Instance 3045f654-72f4-44c7-bc80-92b1b9e549a8 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:29:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:08 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:29:08 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:29:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:08 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Deleted allocations for instance 3045f654-72f4-44c7-bc80-92b1b9e549a8
Nov 15 23:29:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-f61190e6-3ebe-4662-863e-3fdf6b166bbb req-44bfd291-bc58-4663-92fc-d73d0694a6bd service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f61190e6-3ebe-4662-863e-3fdf6b166bbb req-44bfd291-bc58-4663-92fc-d73d0694a6bd service nova] Acquiring lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f61190e6-3ebe-4662-863e-3fdf6b166bbb req-44bfd291-bc58-4663-92fc-d73d0694a6bd service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f61190e6-3ebe-4662-863e-3fdf6b166bbb req-44bfd291-bc58-4663-92fc-d73d0694a6bd service nova] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-f61190e6-3ebe-4662-863e-3fdf6b166bbb req-44bfd291-bc58-4663-92fc-d73d0694a6bd service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] No waiting events found dispatching network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:08 user nova-compute[76391]: WARNING nova.compute.manager [req-f61190e6-3ebe-4662-863e-3fdf6b166bbb req-44bfd291-bc58-4663-92fc-d73d0694a6bd service nova] [instance: 3045f654-72f4-44c7-bc80-92b1b9e549a8] Received unexpected event network-vif-plugged-8acb3576-ff3c-4297-9fd7-ee981710af13 for instance with vm_state deleted and task_state None.
Nov 15 23:29:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bd33835a-7185-4727-8dcb-9e472b388727 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "3045f654-72f4-44c7-bc80-92b1b9e549a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vigHfkjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:29:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:09 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[684204d4-a06a-42a7-80f9-4f3a4ca3a558]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:29:09 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0245bb4f-e8d0-417b-bf1b-58fa1678a7fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226] added
Nov 15 23:29:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eae603-2a25-4d0b-9ffa-ecba82032a9c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b9df24-7624-43ab-a84e-12f5962580a9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vigHfkjY {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vigHfkjY" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10e255-5066-461c-bb1d-13930e4ef697]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vigHfkjY'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82685abc-a4b5-482e-ac95-440c0fd3ccdd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43cafc8-0973-474d-9d5e-2d310f7ecb27]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bdfdaa-edc6-44e5-a60c-9e5d9df54cf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260]
Nov 15 23:29:09 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260] successful.
Nov 15 23:29:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a9a369-9abb-42ff-b0fa-ce23821eb03a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5621719-cf0e-4755-989b-e90fe690d888]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 (non-flash)
Nov 15 23:29:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:09 user nova-compute[76391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 (non-flash)
Nov 15 23:29:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff023c3-48f0-4f71-856d-d8e2723e5f2e]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:29:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vigHfkjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:29:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23737313266343964', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:29:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737313266343964', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:29:10 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid 5016e2a6-3131-4107-a002-37993287edce {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:29:10 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:29:10 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:29:10 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:29:10 user nova-compute[76391]:   <serial>e9a39bf3-5428-4719-93ba-787cba61f226</serial>
Nov 15 23:29:10 user nova-compute[76391]: </disk>
Nov 15 23:29:10 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:29:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No VIF found with MAC fa:16:3e:51:a5:ab, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:29:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d63f6981-5080-4cc6-a1a4-014a4eb48a3e tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.271s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:12 user nova-compute[76391]: INFO nova.compute.manager [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Detaching volume e9a39bf3-5428-4719-93ba-787cba61f226
Nov 15 23:29:12 user nova-compute[76391]: INFO nova.virt.block_device [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Attempting to driver detach volume e9a39bf3-5428-4719-93ba-787cba61f226 from mountpoint /dev/vdb
Nov 15 23:29:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Attempting to detach device vdb from instance 5016e2a6-3131-4107-a002-37993287edce from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:29:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:29:12 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:29:12 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:29:12 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:29:12 user nova-compute[76391]:   <serial>e9a39bf3-5428-4719-93ba-787cba61f226</serial>
Nov 15 23:29:12 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:29:12 user nova-compute[76391]: </disk>
Nov 15 23:29:12 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:29:12 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully detached device vdb from instance 5016e2a6-3131-4107-a002-37993287edce from the persistent domain config.
Nov 15 23:29:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5016e2a6-3131-4107-a002-37993287edce from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:29:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:29:12 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:29:12 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:29:12 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:29:12 user nova-compute[76391]:   <serial>e9a39bf3-5428-4719-93ba-787cba61f226</serial>
Nov 15 23:29:12 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:29:12 user nova-compute[76391]: </disk>
Nov 15 23:29:12 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:29:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5016e2a6-3131-4107-a002-37993287edce {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:29:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [{"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-4559c90b-6fb9-4190-8d40-0832c743c2c7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:29:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:29:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:29:25 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:29:25 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7137MB free_disk=24.941490173339844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Applying migration context for instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b as it has an incoming, in-progress migration 9997678e-d974-4046-a075-27c9a2833dc0. Migration status is finished {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 23:29:26 user nova-compute[76391]: INFO nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating resource usage from migration 9997678e-d974-4046-a075-27c9a2833dc0
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 5016e2a6-3131-4107-a002-37993287edce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3913ccaf-90f8-4196-bb56-3cee0547dee4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 745360bd-e3db-4960-870a-ea1889afff5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Migration 9997678e-d974-4046-a075-27c9a2833dc0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 63907be3-2f2f-4d5f-921d-20020c1a018b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:29:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:29:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:32 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5016e2a6-3131-4107-a002-37993287edce is timed out.
Nov 15 23:29:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully detached device vdb from instance 5016e2a6-3131-4107-a002-37993287edce from the live domain config.
Nov 15 23:29:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vigHfkjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:29:32 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c9c6af-0230-4fd8-911b-2824f10919ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:29:32 user nova-compute[76391]: No targets found.
Nov 15 23:29:32 user nova-compute[76391]: iSNS:
Nov 15 23:29:32 user nova-compute[76391]: No targets found.
Nov 15 23:29:32 user nova-compute[76391]: STATIC:
Nov 15 23:29:32 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226
Nov 15 23:29:32 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:32 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:32 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:29:32 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:32 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:32 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:29:32 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:32 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:32 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:29:32 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:29:32 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:29:32 user nova-compute[76391]: FIRMWARE:
Nov 15 23:29:32 user nova-compute[76391]: No targets found.
Nov 15 23:29:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:29:32 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:29:32 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff6cbe2-fec9-4328-9926-8dcf78e5c6ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8739203-577e-47d2-b5cd-3c56b5a454ea]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:32 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:32 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:32 user nova-compute[76391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 (non-flash)
Nov 15 23:29:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:32 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:32 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:32 user nova-compute[76391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 (non-flash)
Nov 15 23:29:32 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f974037e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8537c-5db7-4e5c-8e60-d296f781fc7c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af8306-e547-4bc3-812d-2507ae2ed41c]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[45daa2e2-128a-4610-9d57-2fbebdb3b9d4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f617522-078e-4c78-8201-79bf445b287d]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[504fda80-2bf0-4339-b8c8-11c6a2514894]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cc9389-4a3b-48e3-ba72-332a28e1453a]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260]
Nov 15 23:29:33 user nova-compute[76391]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226, portal: 172.16.0.220,3260] successful.
Nov 15 23:29:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9a39bf3-5428-4719-93ba-787cba61f226 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[134d13c4-2326-49b2-8438-8cfcb36a62ab]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== disconnect_volume: return (295ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid 5016e2a6-3131-4107-a002-37993287edce {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ea5be117-3b6b-405f-bc44-fffec99e0d9c tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:35 user nova-compute[76391]: INFO nova.compute.manager [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Rescuing
Nov 15 23:29:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG nova.network.neutron [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG nova.network.neutron [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Updating instance_info_cache with network_info: [{"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-7740a863-45d0-46cc-9a54-63ba612749a7 req-9375959e-3be7-4807-8bf0-cda267de5857 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7740a863-45d0-46cc-9a54-63ba612749a7 req-9375959e-3be7-4807-8bf0-cda267de5857 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7740a863-45d0-46cc-9a54-63ba612749a7 req-9375959e-3be7-4807-8bf0-cda267de5857 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7740a863-45d0-46cc-9a54-63ba612749a7 req-9375959e-3be7-4807-8bf0-cda267de5857 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-7740a863-45d0-46cc-9a54-63ba612749a7 req-9375959e-3be7-4807-8bf0-cda267de5857 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:35 user nova-compute[76391]: WARNING nova.compute.manager [req-7740a863-45d0-46cc-9a54-63ba612749a7 req-9375959e-3be7-4807-8bf0-cda267de5857 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state active and task_state rescuing.
Nov 15 23:29:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance destroyed successfully.
Nov 15 23:29:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Attempting a stable device rescue
Nov 15 23:29:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 23:29:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:29:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Creating image(s)
Nov 15 23:29:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "/opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "/opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:36 user nova-compute[76391]: DEBUG nova.objects.instance [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "380f002a96ea598463a4feb2659133ba7effbda5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "380f002a96ea598463a4feb2659133ba7effbda5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.part --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG nova.virt.images [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] 3d35f588-6bd9-400c-ba10-05b372e4355b was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.part /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf8fa947-3f5e-44ef-baf6-05ae8514c75a req-e8337de4-ab3e-4aee-a262-72cd0f02f6e8 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf8fa947-3f5e-44ef-baf6-05ae8514c75a req-e8337de4-ab3e-4aee-a262-72cd0f02f6e8 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf8fa947-3f5e-44ef-baf6-05ae8514c75a req-e8337de4-ab3e-4aee-a262-72cd0f02f6e8 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cf8fa947-3f5e-44ef-baf6-05ae8514c75a req-e8337de4-ab3e-4aee-a262-72cd0f02f6e8 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf8fa947-3f5e-44ef-baf6-05ae8514c75a req-e8337de4-ab3e-4aee-a262-72cd0f02f6e8 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:37 user nova-compute[76391]: WARNING nova.compute.manager [req-cf8fa947-3f5e-44ef-baf6-05ae8514c75a req-e8337de4-ab3e-4aee-a262-72cd0f02f6e8 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state active and task_state rescuing.
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.part /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.converted" returned: 0 in 0.397s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "380f002a96ea598463a4feb2659133ba7effbda5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.925s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "380f002a96ea598463a4feb2659133ba7effbda5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "380f002a96ea598463a4feb2659133ba7effbda5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5 --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5,backing_fmt=raw /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5,backing_fmt=raw /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue" returned: 0 in 0.046s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "380f002a96ea598463a4feb2659133ba7effbda5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'migration_context' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<3913ccaf-90f8-4196-bb56-3cee0547dee4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Start _get_guest_xml network_info=[{"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "vif_mac": "fa:16:3e:20:83:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3d35f588-6bd9-400c-ba10-05b372e4355b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhQxwqng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '3913ccaf-90f8-4196-bb56-3cee0547dee4', 'attached_at': '', 'detached_at': '', 'volume_id': '9306311e-e3bb-4a7f-924b-d73a479fc82f', 'serial': '9306311e-e3bb-4a7f-924b-d73a479fc82f'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '991c6b17-aee4-4963-b6a6-75f62b8c01a1', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'resources' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<3913ccaf-90f8-4196-bb56-3cee0547dee4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'numa_topology' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<3913ccaf-90f8-4196-bb56-3cee0547dee4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:38 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:29:38 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<3913ccaf-90f8-4196-bb56-3cee0547dee4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhQxwqng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:29:38 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:38 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:38 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86268f88-f3f3-4b75-8478-bf996bc4c4c0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VhQxwqng\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 23:29:38 user nova-compute[76391]: node.name = iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:29:38 user nova-compute[76391]: node.tpgt = -1
Nov 15 23:29:38 user nova-compute[76391]: node.startup = automatic
Nov 15 23:29:38 user nova-compute[76391]: node.leading_login = No
Nov 15 23:29:38 user nova-compute[76391]: iface.iscsi_ifacename = default
Nov 15 23:29:38 user nova-compute[76391]: iface.net_ifacename = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.ipaddress = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.prefix_len = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.hwaddress = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.transport_name = tcp
Nov 15 23:29:38 user nova-compute[76391]: iface.initiatorname = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.state = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.vlan_id = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.vlan_priority = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.vlan_state = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.iface_num = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.mtu = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.port = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.bootproto = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.subnet_mask = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.gateway = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_alt_client_id = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_dns = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_learn_iqn = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_vendor_id_state = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_vendor_id = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.dhcp_slp_da = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.fragmentation = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.gratuitous_arp = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.incoming_forwarding = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.tos_state = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.tos = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.ttl = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.delayed_ack = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.tcp_nagle = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.tcp_wsf_state = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.tcp_wsf = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.tcp_timer_scale = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.tcp_timestamp = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.redirect = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.def_task_mgmt_timeout = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.header_digest = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.data_digest = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.immediate_data = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.initial_r2t = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.data_seq_inorder = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.data_pdu_inorder = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.erl = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.max_receive_data_len = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.first_burst_len = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.max_outstanding_r2t = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.max_burst_len = 0
Nov 15 23:29:38 user nova-compute[76391]: iface.chap_auth = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.bidi_chap = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.strict_login_compliance = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.discovery_auth = <empty>
Nov 15 23:29:38 user nova-compute[76391]: iface.discovery_logout = <empty>
Nov 15 23:29:38 user nova-compute[76391]: node.discovery_address = <empty>
Nov 15 23:29:38 user nova-compute[76391]: node.discovery_port = 0
Nov 15 23:29:38 user nova-compute[76391]: node.discovery_type = static
Nov 15 23:29:38 user nova-compute[76391]: node.session.initial_cmdsn = 0
Nov 15 23:29:38 user nova-compute[76391]: node.session.initial_login_retry_max = 8
Nov 15 23:29:38 user nova-compute[76391]: node.session.xmit_thread_priority = -20
Nov 15 23:29:38 user nova-compute[76391]: node.session.cmds_max = 128
Nov 15 23:29:38 user nova-compute[76391]: node.session.queue_depth = 32
Nov 15 23:29:38 user nova-compute[76391]: node.session.nr_sessions = 1
Nov 15 23:29:38 user nova-compute[76391]: node.session.auth.authmethod = CHAP
Nov 15 23:29:38 user nova-compute[76391]: node.session.auth.username = VhQxwqng
Nov 15 23:29:38 user nova-compute[76391]: node.session.auth.password = ***
Nov 15 23:29:38 user nova-compute[76391]: node.session.auth.username_in = <empty>
Nov 15 23:29:38 user nova-compute[76391]: node.session.auth.password_in = <empty>
Nov 15 23:29:38 user nova-compute[76391]: node.session.auth.chap_algs = MD5
Nov 15 23:29:38 user nova-compute[76391]: node.session.timeo.replacement_timeout = 120
Nov 15 23:29:38 user nova-compute[76391]: node.session.err_timeo.abort_timeout = 15
Nov 15 23:29:38 user nova-compute[76391]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 23:29:38 user nova-compute[76391]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 23:29:38 user nova-compute[76391]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.FastAbort = Yes
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.InitialR2T = No
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.ImmediateData = Yes
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.MaxConnections = 1
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 23:29:38 user nova-compute[76391]: node.session.iscsi.ERL = 0
Nov 15 23:29:38 user nova-compute[76391]: node.session.scan = manual
Nov 15 23:29:38 user nova-compute[76391]: node.session.reopen_max = 0
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].address = 172.16.0.220
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].port = 3260
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].startup = manual
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].tcp.window_size = 524288
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].tcp.type_of_service = 0
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].timeo.logout_timeout = 15
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].timeo.login_timeout = 15
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].timeo.auth_timeout = 45
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].iscsi.DataDigest = None
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].iscsi.IFMarker = No
Nov 15 23:29:38 user nova-compute[76391]: node.conn[0].iscsi.OFMarker = No
Nov 15 23:29:38 user nova-compute[76391]: # END RECORD
Nov 15 23:29:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab51068-a8b0-418f-9b8d-7672b314254c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51042df5-2c72-4180-b100-00a2bc82c217]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhQxwqng {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhQxwqng" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f8b81e-deb0-456a-9148-9bba95bb0cb9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhQxwqng'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1363e09-4275-4c2f-9005-14fdeb4f53be]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8a94c9-4ef3-4da7-b0b0-4505ff62c7b9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:38 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:38 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:38 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:38 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:38 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] HCTL ('38', '0', '0', 0) found on session 34 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e47a06-bc4b-4973-9189-f1f84318b1d0]: (4, ('0 0 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Searching for a device in session 34 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhQxwqng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '26336353463663962', 'path': '/dev/sdg'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336353463663962', 'path': '/dev/sdg'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-425566497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-425566497',id=34,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:28:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-uqewve0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:28:01Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=3913ccaf-90f8-4196-bb56-3cee0547dee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "vif_mac": "fa:16:3e:20:83:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "vif_mac": "fa:16:3e:20:83:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'pci_devices' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.objects.base [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Object Instance<3913ccaf-90f8-4196-bb56-3cee0547dee4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:29:38 user nova-compute[76391]:   <uuid>3913ccaf-90f8-4196-bb56-3cee0547dee4</uuid>
Nov 15 23:29:38 user nova-compute[76391]:   <name>instance-00000022</name>
Nov 15 23:29:38 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:29:38 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:29:38 user nova-compute[76391]:   <metadata>
Nov 15 23:29:38 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:29:38 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:29:38 user nova-compute[76391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-425566497</nova:name>
Nov 15 23:29:38 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:29:38</nova:creationTime>
Nov 15 23:29:38 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:29:38 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:29:38 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:29:38 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:29:38 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:29:38 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:29:38 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:29:38 user nova-compute[76391]:       <nova:owner>
Nov 15 23:29:38 user nova-compute[76391]:         <nova:user uuid="323a9405e8854778bf826678f8ae876f">tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member</nova:user>
Nov 15 23:29:38 user nova-compute[76391]:         <nova:project uuid="9c28a381270e4f489acbbc7702c64c61">tempest-ServerBootFromVolumeStableRescueTest-194934661</nova:project>
Nov 15 23:29:38 user nova-compute[76391]:       </nova:owner>
Nov 15 23:29:38 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:29:38 user nova-compute[76391]:       <nova:ports>
Nov 15 23:29:38 user nova-compute[76391]:         <nova:port uuid="20867220-4b30-4291-96cc-6ff070d82773">
Nov 15 23:29:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 23:29:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:29:38 user nova-compute[76391]:       </nova:ports>
Nov 15 23:29:38 user nova-compute[76391]:     </nova:instance>
Nov 15 23:29:38 user nova-compute[76391]:   </metadata>
Nov 15 23:29:38 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:29:38 user nova-compute[76391]:     <system>
Nov 15 23:29:38 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:29:38 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:29:38 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:29:38 user nova-compute[76391]:       <entry name="serial">3913ccaf-90f8-4196-bb56-3cee0547dee4</entry>
Nov 15 23:29:38 user nova-compute[76391]:       <entry name="uuid">3913ccaf-90f8-4196-bb56-3cee0547dee4</entry>
Nov 15 23:29:38 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:29:38 user nova-compute[76391]:     </system>
Nov 15 23:29:38 user nova-compute[76391]:   </sysinfo>
Nov 15 23:29:38 user nova-compute[76391]:   <os>
Nov 15 23:29:38 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:29:38 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:29:38 user nova-compute[76391]:   </os>
Nov 15 23:29:38 user nova-compute[76391]:   <features>
Nov 15 23:29:38 user nova-compute[76391]:     <acpi/>
Nov 15 23:29:38 user nova-compute[76391]:     <apic/>
Nov 15 23:29:38 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:29:38 user nova-compute[76391]:   </features>
Nov 15 23:29:38 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:29:38 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:29:38 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:29:38 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:29:38 user nova-compute[76391]:   </clock>
Nov 15 23:29:38 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:29:38 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:29:38 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:29:38 user nova-compute[76391]:   </cpu>
Nov 15 23:29:38 user nova-compute[76391]:   <devices>
Nov 15 23:29:38 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:29:38 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:29:38 user nova-compute[76391]:       <source dev="/dev/sdg"/>
Nov 15 23:29:38 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:29:38 user nova-compute[76391]:       <serial>9306311e-e3bb-4a7f-924b-d73a479fc82f</serial>
Nov 15 23:29:38 user nova-compute[76391]:     </disk>
Nov 15 23:29:38 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:29:38 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:29:38 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue"/>
Nov 15 23:29:38 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:29:38 user nova-compute[76391]:       <boot order="1"/>
Nov 15 23:29:38 user nova-compute[76391]:     </disk>
Nov 15 23:29:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:29:38 user nova-compute[76391]:       <mac address="fa:16:3e:20:83:e4"/>
Nov 15 23:29:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:29:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:29:38 user nova-compute[76391]:       <target dev="tap20867220-4b"/>
Nov 15 23:29:38 user nova-compute[76391]:     </interface>
Nov 15 23:29:38 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:29:38 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/console.log" append="off"/>
Nov 15 23:29:38 user nova-compute[76391]:     </serial>
Nov 15 23:29:38 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:29:38 user nova-compute[76391]:     <video>
Nov 15 23:29:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:29:38 user nova-compute[76391]:     </video>
Nov 15 23:29:38 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:29:38 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:29:38 user nova-compute[76391]:     </rng>
Nov 15 23:29:38 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:29:38 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:29:38 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:29:38 user nova-compute[76391]:     </memballoon>
Nov 15 23:29:38 user nova-compute[76391]:   </devices>
Nov 15 23:29:38 user nova-compute[76391]: </domain>
Nov 15 23:29:38 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:29:38 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance destroyed successfully.
Nov 15 23:29:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] No VIF found with MAC fa:16:3e:20:83:e4, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-3978153a-60ec-4cce-b7a1-a96076488a12 req-0b42827b-15ce-4368-a5eb-616401bed262 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3978153a-60ec-4cce-b7a1-a96076488a12 req-0b42827b-15ce-4368-a5eb-616401bed262 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3978153a-60ec-4cce-b7a1-a96076488a12 req-0b42827b-15ce-4368-a5eb-616401bed262 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3978153a-60ec-4cce-b7a1-a96076488a12 req-0b42827b-15ce-4368-a5eb-616401bed262 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-3978153a-60ec-4cce-b7a1-a96076488a12 req-0b42827b-15ce-4368-a5eb-616401bed262 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:40 user nova-compute[76391]: WARNING nova.compute.manager [req-3978153a-60ec-4cce-b7a1-a96076488a12 req-0b42827b-15ce-4368-a5eb-616401bed262 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state active and task_state rescuing.
Nov 15 23:29:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-802205ef-fcf2-432c-b30a-a87ab5ddaea9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:29:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-41dac9d2-396e-4c5e-885c-4dcb681974ef req-4a9cbc77-6af4-4426-b0c5-955b6c2967d5 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-41dac9d2-396e-4c5e-885c-4dcb681974ef req-4a9cbc77-6af4-4426-b0c5-955b6c2967d5 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-41dac9d2-396e-4c5e-885c-4dcb681974ef req-4a9cbc77-6af4-4426-b0c5-955b6c2967d5 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-41dac9d2-396e-4c5e-885c-4dcb681974ef req-4a9cbc77-6af4-4426-b0c5-955b6c2967d5 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-41dac9d2-396e-4c5e-885c-4dcb681974ef req-4a9cbc77-6af4-4426-b0c5-955b6c2967d5 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:42 user nova-compute[76391]: WARNING nova.compute.manager [req-41dac9d2-396e-4c5e-885c-4dcb681974ef req-4a9cbc77-6af4-4426-b0c5-955b6c2967d5 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state rescued and task_state None.
Nov 15 23:29:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'flavor' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:43 user nova-compute[76391]: INFO nova.compute.manager [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Attaching volume bc74c6dd-8f18-4c35-a0fc-72a567954344 to /dev/vdb
Nov 15 23:29:43 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a09ca74-7d65-41d2-ab41-485ad8fdff7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea2a34-6ead-4083-b281-694e88545954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc959daf-6193-4ca7-b780-d1b62dfb2322]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3201ca-d3b6-49ae-84ca-7f71134b83c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:29:43 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:29:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d104065-6ae3-458d-933a-bb06b24257a1]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG os_brick.utils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:29:43 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating existing volume attachment record: 1664a2c0-a909-4207-b33a-761bb706162c {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:29:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing instance network info cache due to event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:29:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] Acquiring lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:29:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] Acquired lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:29:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:29:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updated VIF entry in instance network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:29:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bc38fe2a-d480-4971-8f90-b223aa21eb78 req-876f221a-74ee-49b9-a408-6a78576a4e4a service nova] Releasing lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:29:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afbrhFVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:29:49 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:49 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:29:49 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4760500-8c3d-4b20-a468-a3e660eddcce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:29:49 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1d1b78-c3b5-425d-bbfe-8713f455268a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344] added
Nov 15 23:29:49 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d91f7-1111-450d-a54d-12ee13266096]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdbddb2-049d-48be-9a9a-1b509d24b8aa]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afbrhFVq {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afbrhFVq" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d933e3c8-4d84-4655-9f0b-3ff45b22f988]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afbrhFVq'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ddfcb-293a-4070-8537-ad1b79544c93]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa50a92-4c1f-4f10-95df-4fea039df518]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:49 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:49 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff98907e-2029-489c-885f-7212c0e8e88b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260]
Nov 15 23:29:49 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260] successful.
Nov 15 23:29:49 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f0857-8e69-49ff-b4f6-81d8c6b5f446]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[939cceb1-86d3-42eb-84e7-aa58a5ecd13c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:29:49 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:29:49 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:29:49 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aad69a-2a10-4e3c-97d7-43b8e976dda7]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:29:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afbrhFVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:29:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:29:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26538303036663466', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:29:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538303036663466', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:29:50 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'flavor' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:29:50 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:29:50 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:29:50 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:29:50 user nova-compute[76391]:   <serial>bc74c6dd-8f18-4c35-a0fc-72a567954344</serial>
Nov 15 23:29:50 user nova-compute[76391]: </disk>
Nov 15 23:29:50 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:29:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No VIF found with MAC fa:16:3e:d9:b7:a7, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:29:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5c9b16cf-a8cc-4b98-a175-e0a6f7c1b874 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.718s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:52 user nova-compute[76391]: INFO nova.compute.manager [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Rescuing
Nov 15 23:29:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:29:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:29:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:29:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:29:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-4780bd5f-a62b-46e6-96a7-d2d90cc37653 req-e0543a12-7a94-43e6-b082-1032633b014f service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4780bd5f-a62b-46e6-96a7-d2d90cc37653 req-e0543a12-7a94-43e6-b082-1032633b014f service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4780bd5f-a62b-46e6-96a7-d2d90cc37653 req-e0543a12-7a94-43e6-b082-1032633b014f service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4780bd5f-a62b-46e6-96a7-d2d90cc37653 req-e0543a12-7a94-43e6-b082-1032633b014f service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-4780bd5f-a62b-46e6-96a7-d2d90cc37653 req-e0543a12-7a94-43e6-b082-1032633b014f service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:53 user nova-compute[76391]: WARNING nova.compute.manager [req-4780bd5f-a62b-46e6-96a7-d2d90cc37653 req-e0543a12-7a94-43e6-b082-1032633b014f service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state active and task_state rescuing.
Nov 15 23:29:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:53 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance destroyed successfully.
Nov 15 23:29:53 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Attempting rescue
Nov 15 23:29:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance directory exists: not creating {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 23:29:53 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Creating image(s)
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'trusted_certs' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue" returned: 0 in 0.052s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'migration_context' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.base [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<b3fb89ce-7ba2-47c7-af46-7a0051332a0f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Start _get_guest_xml network_info=[{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:d9:b7:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'resources' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.base [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<b3fb89ce-7ba2-47c7-af46-7a0051332a0f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'numa_topology' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.base [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<b3fb89ce-7ba2-47c7-af46-7a0051332a0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:29:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.base [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<b3fb89ce-7ba2-47c7-af46-7a0051332a0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-981583528',display_name='tempest-ServerRescueNegativeTestJSON-server-981583528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-981583528',id=35,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIomkJe45ki1cIYUkPS1QNjMQCyBktjIJXwWsY7ulKFg7nff4Bz84pHhi23s1LSsAqYsBwfT0r/bsl3OIKzBSg3EyL31y7rTJAmPX658xmYM1Ec9jZsHDP4Fs215Jaumkg==',key_name='tempest-keypair-935125858',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-i1klz6my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3986dd9981e24a0f8faf441662255bab',uuid=b3fb89ce-7ba2-47c7-af46-7a0051332a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:d9:b7:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "vif_mac": "fa:16:3e:d9:b7:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'pci_devices' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.objects.base [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Object Instance<b3fb89ce-7ba2-47c7-af46-7a0051332a0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:29:54 user nova-compute[76391]:   <uuid>b3fb89ce-7ba2-47c7-af46-7a0051332a0f</uuid>
Nov 15 23:29:54 user nova-compute[76391]:   <name>instance-00000023</name>
Nov 15 23:29:54 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:29:54 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:29:54 user nova-compute[76391]:   <metadata>
Nov 15 23:29:54 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:29:54 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:29:54 user nova-compute[76391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-981583528</nova:name>
Nov 15 23:29:54 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:29:54</nova:creationTime>
Nov 15 23:29:54 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:29:54 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:29:54 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:29:54 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:29:54 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:29:54 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:29:54 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:29:54 user nova-compute[76391]:       <nova:owner>
Nov 15 23:29:54 user nova-compute[76391]:         <nova:user uuid="3986dd9981e24a0f8faf441662255bab">tempest-ServerRescueNegativeTestJSON-1623431733-project-member</nova:user>
Nov 15 23:29:54 user nova-compute[76391]:         <nova:project uuid="3d522b2994d4474999b1a2d2d474c74b">tempest-ServerRescueNegativeTestJSON-1623431733</nova:project>
Nov 15 23:29:54 user nova-compute[76391]:       </nova:owner>
Nov 15 23:29:54 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:29:54 user nova-compute[76391]:       <nova:ports>
Nov 15 23:29:54 user nova-compute[76391]:         <nova:port uuid="ffb183fe-4372-4617-98a2-4e90975d4876">
Nov 15 23:29:54 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:29:54 user nova-compute[76391]:         </nova:port>
Nov 15 23:29:54 user nova-compute[76391]:       </nova:ports>
Nov 15 23:29:54 user nova-compute[76391]:     </nova:instance>
Nov 15 23:29:54 user nova-compute[76391]:   </metadata>
Nov 15 23:29:54 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:29:54 user nova-compute[76391]:     <system>
Nov 15 23:29:54 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:29:54 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:29:54 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:29:54 user nova-compute[76391]:       <entry name="serial">b3fb89ce-7ba2-47c7-af46-7a0051332a0f</entry>
Nov 15 23:29:54 user nova-compute[76391]:       <entry name="uuid">b3fb89ce-7ba2-47c7-af46-7a0051332a0f</entry>
Nov 15 23:29:54 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:29:54 user nova-compute[76391]:     </system>
Nov 15 23:29:54 user nova-compute[76391]:   </sysinfo>
Nov 15 23:29:54 user nova-compute[76391]:   <os>
Nov 15 23:29:54 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:29:54 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:29:54 user nova-compute[76391]:   </os>
Nov 15 23:29:54 user nova-compute[76391]:   <features>
Nov 15 23:29:54 user nova-compute[76391]:     <acpi/>
Nov 15 23:29:54 user nova-compute[76391]:     <apic/>
Nov 15 23:29:54 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:29:54 user nova-compute[76391]:   </features>
Nov 15 23:29:54 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:29:54 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:29:54 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:29:54 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:29:54 user nova-compute[76391]:   </clock>
Nov 15 23:29:54 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:29:54 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:29:54 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:29:54 user nova-compute[76391]:   </cpu>
Nov 15 23:29:54 user nova-compute[76391]:   <devices>
Nov 15 23:29:54 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:29:54 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:29:54 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue"/>
Nov 15 23:29:54 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:29:54 user nova-compute[76391]:     </disk>
Nov 15 23:29:54 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:29:54 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:29:54 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk"/>
Nov 15 23:29:54 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:29:54 user nova-compute[76391]:     </disk>
Nov 15 23:29:54 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:29:54 user nova-compute[76391]:       <mac address="fa:16:3e:d9:b7:a7"/>
Nov 15 23:29:54 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:29:54 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:29:54 user nova-compute[76391]:       <target dev="tapffb183fe-43"/>
Nov 15 23:29:54 user nova-compute[76391]:     </interface>
Nov 15 23:29:54 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:29:54 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/console.log" append="off"/>
Nov 15 23:29:54 user nova-compute[76391]:     </serial>
Nov 15 23:29:54 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:29:54 user nova-compute[76391]:     <video>
Nov 15 23:29:54 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:29:54 user nova-compute[76391]:     </video>
Nov 15 23:29:54 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:29:54 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:29:54 user nova-compute[76391]:     </rng>
Nov 15 23:29:54 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:29:54 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:29:54 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:29:54 user nova-compute[76391]:     </memballoon>
Nov 15 23:29:54 user nova-compute[76391]:   </devices>
Nov 15 23:29:54 user nova-compute[76391]: </domain>
Nov 15 23:29:54 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:29:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance destroyed successfully.
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:29:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] No VIF found with MAC fa:16:3e:d9:b7:a7, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-5289fae4-612d-43cd-b7f0-e0c2e48a3b2e req-5a13a524-8232-4369-ae15-b6875726c779 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5289fae4-612d-43cd-b7f0-e0c2e48a3b2e req-5a13a524-8232-4369-ae15-b6875726c779 service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5289fae4-612d-43cd-b7f0-e0c2e48a3b2e req-5a13a524-8232-4369-ae15-b6875726c779 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5289fae4-612d-43cd-b7f0-e0c2e48a3b2e req-5a13a524-8232-4369-ae15-b6875726c779 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-5289fae4-612d-43cd-b7f0-e0c2e48a3b2e req-5a13a524-8232-4369-ae15-b6875726c779 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:55 user nova-compute[76391]: WARNING nova.compute.manager [req-5289fae4-612d-43cd-b7f0-e0c2e48a3b2e req-5a13a524-8232-4369-ae15-b6875726c779 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state active and task_state rescuing.
Nov 15 23:29:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:57 user nova-compute[76391]: WARNING nova.compute.manager [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state active and task_state rescuing.
Nov 15 23:29:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:29:57 user nova-compute[76391]: WARNING nova.compute.manager [req-8a26f820-74cf-4ba8-8ef8-e00bde6a0328 req-08e66089-af28-4487-9b85-c7951a39056b service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state active and task_state rescuing.
Nov 15 23:29:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:29:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d228d16f-6729-4a74-895e-abb4a75a8bf5 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:29:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:29:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:29:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:29:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:29:59 user nova-compute[76391]: INFO nova.compute.claims [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Claim successful on node user
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.network.neutron [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:30:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.policy [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45a3062019c454d8cc5321e130f8286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8145bb6c79f347f39e0a46758d3683ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:30:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Creating image(s)
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk 1073741824" returned: 0 in 0.048s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Successfully created port: d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.283s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Cannot resize image /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Ensure instance console log exists: /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Successfully updated port: d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquired lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing instance network info cache due to event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] Acquiring lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:02 user nova-compute[76391]: INFO nova.compute.manager [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Terminating instance
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Releasing lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance network_info: |[{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] Acquired lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.network.neutron [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Start _get_guest_xml network_info=[{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:30:02 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:02 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1243535592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1243535592',id=38,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdbfGGv5EeyneUZURLXjRY2yTJ9CO3AUtVZfrZykUhK+aboka7jRiPibMIDsnB6QsaVUABdNRiFp9ZCGnjTWZI/H4y1pZkfK0sb54p1ToZcJn51z96MAbQ9FbGzZ+df7Q==',key_name='tempest-keypair-1914316400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-4xpnjva7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=80a0c2c9-85a3-4895-b5d8-8544e44a4f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.objects.instance [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'pci_devices' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:30:02 user nova-compute[76391]:   <uuid>80a0c2c9-85a3-4895-b5d8-8544e44a4f6c</uuid>
Nov 15 23:30:02 user nova-compute[76391]:   <name>instance-00000026</name>
Nov 15 23:30:02 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:30:02 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:30:02 user nova-compute[76391]:   <metadata>
Nov 15 23:30:02 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:30:02 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:30:02 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1243535592</nova:name>
Nov 15 23:30:02 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:30:02</nova:creationTime>
Nov 15 23:30:02 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:30:02 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:30:02 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:30:02 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:30:02 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:30:02 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:30:02 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:30:02 user nova-compute[76391]:       <nova:owner>
Nov 15 23:30:02 user nova-compute[76391]:         <nova:user uuid="e45a3062019c454d8cc5321e130f8286">tempest-AttachVolumeShelveTestJSON-959550804-project-member</nova:user>
Nov 15 23:30:02 user nova-compute[76391]:         <nova:project uuid="8145bb6c79f347f39e0a46758d3683ff">tempest-AttachVolumeShelveTestJSON-959550804</nova:project>
Nov 15 23:30:02 user nova-compute[76391]:       </nova:owner>
Nov 15 23:30:02 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:30:02 user nova-compute[76391]:       <nova:ports>
Nov 15 23:30:02 user nova-compute[76391]:         <nova:port uuid="d4b7186b-3b0a-4262-853b-9212dc427199">
Nov 15 23:30:02 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 23:30:02 user nova-compute[76391]:         </nova:port>
Nov 15 23:30:02 user nova-compute[76391]:       </nova:ports>
Nov 15 23:30:02 user nova-compute[76391]:     </nova:instance>
Nov 15 23:30:02 user nova-compute[76391]:   </metadata>
Nov 15 23:30:02 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:30:02 user nova-compute[76391]:     <system>
Nov 15 23:30:02 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:30:02 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:30:02 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:30:02 user nova-compute[76391]:       <entry name="serial">80a0c2c9-85a3-4895-b5d8-8544e44a4f6c</entry>
Nov 15 23:30:02 user nova-compute[76391]:       <entry name="uuid">80a0c2c9-85a3-4895-b5d8-8544e44a4f6c</entry>
Nov 15 23:30:02 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:30:02 user nova-compute[76391]:     </system>
Nov 15 23:30:02 user nova-compute[76391]:   </sysinfo>
Nov 15 23:30:02 user nova-compute[76391]:   <os>
Nov 15 23:30:02 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:30:02 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:30:02 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:30:02 user nova-compute[76391]:   </os>
Nov 15 23:30:02 user nova-compute[76391]:   <features>
Nov 15 23:30:02 user nova-compute[76391]:     <acpi/>
Nov 15 23:30:02 user nova-compute[76391]:     <apic/>
Nov 15 23:30:02 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:30:02 user nova-compute[76391]:   </features>
Nov 15 23:30:02 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:30:02 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:30:02 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:30:02 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:30:02 user nova-compute[76391]:   </clock>
Nov 15 23:30:02 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:30:02 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:30:02 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:30:02 user nova-compute[76391]:   </cpu>
Nov 15 23:30:02 user nova-compute[76391]:   <devices>
Nov 15 23:30:02 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:30:02 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:30:02 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk"/>
Nov 15 23:30:02 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:30:02 user nova-compute[76391]:     </disk>
Nov 15 23:30:02 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:30:02 user nova-compute[76391]:       <mac address="fa:16:3e:f0:b9:5d"/>
Nov 15 23:30:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:02 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:30:02 user nova-compute[76391]:       <target dev="tapd4b7186b-3b"/>
Nov 15 23:30:02 user nova-compute[76391]:     </interface>
Nov 15 23:30:02 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:30:02 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/console.log" append="off"/>
Nov 15 23:30:02 user nova-compute[76391]:     </serial>
Nov 15 23:30:02 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:30:02 user nova-compute[76391]:     <video>
Nov 15 23:30:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:02 user nova-compute[76391]:     </video>
Nov 15 23:30:02 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:30:02 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:30:02 user nova-compute[76391]:     </rng>
Nov 15 23:30:02 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:30:02 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:30:02 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:30:02 user nova-compute[76391]:     </memballoon>
Nov 15 23:30:02 user nova-compute[76391]:   </devices>
Nov 15 23:30:02 user nova-compute[76391]: </domain>
Nov 15 23:30:02 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1243535592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1243535592',id=38,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdbfGGv5EeyneUZURLXjRY2yTJ9CO3AUtVZfrZykUhK+aboka7jRiPibMIDsnB6QsaVUABdNRiFp9ZCGnjTWZI/H4y1pZkfK0sb54p1ToZcJn51z96MAbQ9FbGzZ+df7Q==',key_name='tempest-keypair-1914316400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-4xpnjva7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=80a0c2c9-85a3-4895-b5d8-8544e44a4f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG os_vif [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66a4111c-4c1b-52d4-893d-33c8a76957c1', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4b7186b-3b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4b7186b-3b, col_values=(('qos', UUID('5ec44b3f-7472-4b58-a727-644be2e44d1c')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4b7186b-3b, col_values=(('external_ids', {'iface-id': 'd4b7186b-3b0a-4262-853b-9212dc427199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:b9:5d', 'vm-uuid': '80a0c2c9-85a3-4895-b5d8-8544e44a4f6c'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-69f3a2fb-01e1-4864-b46e-c7c2a4b04936 req-5213f8c1-a033-4b9c-8d57-da1c71ef35db service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-vif-unplugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-69f3a2fb-01e1-4864-b46e-c7c2a4b04936 req-5213f8c1-a033-4b9c-8d57-da1c71ef35db service nova] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-69f3a2fb-01e1-4864-b46e-c7c2a4b04936 req-5213f8c1-a033-4b9c-8d57-da1c71ef35db service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-69f3a2fb-01e1-4864-b46e-c7c2a4b04936 req-5213f8c1-a033-4b9c-8d57-da1c71ef35db service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-69f3a2fb-01e1-4864-b46e-c7c2a4b04936 req-5213f8c1-a033-4b9c-8d57-da1c71ef35db service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] No waiting events found dispatching network-vif-unplugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-69f3a2fb-01e1-4864-b46e-c7c2a4b04936 req-5213f8c1-a033-4b9c-8d57-da1c71ef35db service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-vif-unplugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:30:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: INFO os_vif [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b')
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No VIF found with MAC fa:16:3e:f0:b9:5d, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.network.neutron [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updated VIF entry in instance network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.network.neutron [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-60dfda7e-30bd-4fe2-ac37-c6460abad50e req-ba77ef33-3957-414b-9a35-959bb03336ed service nova] Releasing lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 5016e2a6-3131-4107-a002-37993287edce] Instance destroyed successfully.
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'resources' on Instance uuid 5016e2a6-3131-4107-a002-37993287edce {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1542901031',display_name='tempest-AttachVolumeNegativeTest-server-1542901031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1542901031',id=33,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWfQ+AiYqYY7vjith/HDCGC8/hFEI3HkeyZKQ/3+k+HAjoPnb5qjLy7+rg5VllhMXwC6EuTh0xKdur9Rasta1mL/J14UNxL3OYkdNhgrikJ83LF+4a0cGGsu/FY9zDdGA==',key_name='tempest-keypair-1856490408',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-8otocq7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=5016e2a6-3131-4107-a002-37993287edce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "address": "fa:16:3e:51:a5:ab", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e0f523-8b", "ovs_interfaceid": "31e0f523-8bd5-48b0-987d-1cd9c5901579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:a5:ab,bridge_name='br-int',has_traffic_filtering=True,id=31e0f523-8bd5-48b0-987d-1cd9c5901579,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e0f523-8b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG os_vif [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:a5:ab,bridge_name='br-int',has_traffic_filtering=True,id=31e0f523-8bd5-48b0-987d-1cd9c5901579,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e0f523-8b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31e0f523-8b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1da0602-05cf-46aa-b29a-749f9d9f01ba) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:03 user nova-compute[76391]: INFO os_vif [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:a5:ab,bridge_name='br-int',has_traffic_filtering=True,id=31e0f523-8bd5-48b0-987d-1cd9c5901579,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e0f523-8b')
Nov 15 23:30:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Deleting instance files /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce_del
Nov 15 23:30:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Deletion of /opt/stack/data/nova/instances/5016e2a6-3131-4107-a002-37993287edce_del complete
Nov 15 23:30:03 user nova-compute[76391]: INFO nova.compute.manager [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 5016e2a6-3131-4107-a002-37993287edce] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 15 23:30:03 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 5016e2a6-3131-4107-a002-37993287edce] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:30:03 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 5016e2a6-3131-4107-a002-37993287edce] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:30:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:04 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-53c4d88c-08a5-4d58-9abb-d0ed4f57507a req-8272c4a2-fff4-4a98-8588-74620ad7e26f service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-vif-deleted-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:04 user nova-compute[76391]: INFO nova.compute.manager [req-53c4d88c-08a5-4d58-9abb-d0ed4f57507a req-8272c4a2-fff4-4a98-8588-74620ad7e26f service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Neutron deleted interface 31e0f523-8bd5-48b0-987d-1cd9c5901579; detaching it from the instance and deleting it from the info cache
Nov 15 23:30:04 user nova-compute[76391]: DEBUG nova.network.neutron [req-53c4d88c-08a5-4d58-9abb-d0ed4f57507a req-8272c4a2-fff4-4a98-8588-74620ad7e26f service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:04 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 5016e2a6-3131-4107-a002-37993287edce] Took 1.09 seconds to deallocate network for instance.
Nov 15 23:30:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-53c4d88c-08a5-4d58-9abb-d0ed4f57507a req-8272c4a2-fff4-4a98-8588-74620ad7e26f service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Detach interface failed, port_id=31e0f523-8bd5-48b0-987d-1cd9c5901579, reason: Instance 5016e2a6-3131-4107-a002-37993287edce could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-0f5f6225-d9f1-4a6a-ad8f-8ec0a764440d req-03b50f88-5135-431c-b0c9-5bf1f2b3b627 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0f5f6225-d9f1-4a6a-ad8f-8ec0a764440d req-03b50f88-5135-431c-b0c9-5bf1f2b3b627 service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0f5f6225-d9f1-4a6a-ad8f-8ec0a764440d req-03b50f88-5135-431c-b0c9-5bf1f2b3b627 service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0f5f6225-d9f1-4a6a-ad8f-8ec0a764440d req-03b50f88-5135-431c-b0c9-5bf1f2b3b627 service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-0f5f6225-d9f1-4a6a-ad8f-8ec0a764440d req-03b50f88-5135-431c-b0c9-5bf1f2b3b627 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:05 user nova-compute[76391]: WARNING nova.compute.manager [req-0f5f6225-d9f1-4a6a-ad8f-8ec0a764440d req-03b50f88-5135-431c-b0c9-5bf1f2b3b627 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received unexpected event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with vm_state building and task_state spawning.
Nov 15 23:30:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-25cf8b3a-986b-400d-93fc-cd55d8fb759f req-3d377384-7c22-4180-b4bc-9adf9549e764 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received event network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-25cf8b3a-986b-400d-93fc-cd55d8fb759f req-3d377384-7c22-4180-b4bc-9adf9549e764 service nova] Acquiring lock "5016e2a6-3131-4107-a002-37993287edce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-25cf8b3a-986b-400d-93fc-cd55d8fb759f req-3d377384-7c22-4180-b4bc-9adf9549e764 service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-25cf8b3a-986b-400d-93fc-cd55d8fb759f req-3d377384-7c22-4180-b4bc-9adf9549e764 service nova] Lock "5016e2a6-3131-4107-a002-37993287edce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-25cf8b3a-986b-400d-93fc-cd55d8fb759f req-3d377384-7c22-4180-b4bc-9adf9549e764 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] No waiting events found dispatching network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:05 user nova-compute[76391]: WARNING nova.compute.manager [req-25cf8b3a-986b-400d-93fc-cd55d8fb759f req-3d377384-7c22-4180-b4bc-9adf9549e764 service nova] [instance: 5016e2a6-3131-4107-a002-37993287edce] Received unexpected event network-vif-plugged-31e0f523-8bd5-48b0-987d-1cd9c5901579 for instance with vm_state deleted and task_state None.
Nov 15 23:30:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:05 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Deleted allocations for instance 5016e2a6-3131-4107-a002-37993287edce
Nov 15 23:30:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6001c0e0-e510-476e-9102-9aa3e460a0d6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "5016e2a6-3131-4107-a002-37993287edce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.249s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:30:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance spawned successfully.
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:07 user nova-compute[76391]: INFO nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2b35171-2300-4d2f-974f-206c24b25b2a req-6357e938-1854-43a2-bfbb-b42d9b6d206d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2b35171-2300-4d2f-974f-206c24b25b2a req-6357e938-1854-43a2-bfbb-b42d9b6d206d service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2b35171-2300-4d2f-974f-206c24b25b2a req-6357e938-1854-43a2-bfbb-b42d9b6d206d service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d2b35171-2300-4d2f-974f-206c24b25b2a req-6357e938-1854-43a2-bfbb-b42d9b6d206d service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-d2b35171-2300-4d2f-974f-206c24b25b2a req-6357e938-1854-43a2-bfbb-b42d9b6d206d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:07 user nova-compute[76391]: WARNING nova.compute.manager [req-d2b35171-2300-4d2f-974f-206c24b25b2a req-6357e938-1854-43a2-bfbb-b42d9b6d206d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received unexpected event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with vm_state building and task_state spawning.
Nov 15 23:30:07 user nova-compute[76391]: INFO nova.compute.manager [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Took 7.69 seconds to build instance.
Nov 15 23:30:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-dde35f3e-8831-4c22-a9aa-c179750170a1 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.844s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:30:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:30:08 user nova-compute[76391]: INFO nova.compute.claims [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Claim successful on node user
Nov 15 23:30:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.network.neutron [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:30:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.policy [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efa0b862a4e54967ba27a6cc88bb5496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f76509cb8a4588a018268eee3eb14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:30:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Creating image(s)
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.241s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.212s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk 1073741824" returned: 0 in 0.058s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Successfully created port: e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.205s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Cannot resize image /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Ensure instance console log exists: /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Successfully updated port: e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquired lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-changed-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Refreshing instance network info cache due to event network-changed-e9b8989d-623b-41ab-afe4-80edc71bb67c. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] Acquiring lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:10 user nova-compute[76391]: DEBUG nova.network.neutron [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.neutron [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Releasing lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance network_info: |[{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] Acquired lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.neutron [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Refreshing network info cache for port e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Start _get_guest_xml network_info=[{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:30:11 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:11 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'pci_devices' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:30:11 user nova-compute[76391]:   <uuid>6be3d794-c793-4da2-bfa2-8547215014ca</uuid>
Nov 15 23:30:11 user nova-compute[76391]:   <name>instance-00000027</name>
Nov 15 23:30:11 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:30:11 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:30:11 user nova-compute[76391]:   <metadata>
Nov 15 23:30:11 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:30:11 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:30:11 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeTestJSON-server-1699613562</nova:name>
Nov 15 23:30:11 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:30:11</nova:creationTime>
Nov 15 23:30:11 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:30:11 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:30:11 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:30:11 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:30:11 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:30:11 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:30:11 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:30:11 user nova-compute[76391]:       <nova:owner>
Nov 15 23:30:11 user nova-compute[76391]:         <nova:user uuid="efa0b862a4e54967ba27a6cc88bb5496">tempest-AttachVolumeTestJSON-1495860226-project-member</nova:user>
Nov 15 23:30:11 user nova-compute[76391]:         <nova:project uuid="28f76509cb8a4588a018268eee3eb14a">tempest-AttachVolumeTestJSON-1495860226</nova:project>
Nov 15 23:30:11 user nova-compute[76391]:       </nova:owner>
Nov 15 23:30:11 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:30:11 user nova-compute[76391]:       <nova:ports>
Nov 15 23:30:11 user nova-compute[76391]:         <nova:port uuid="e9b8989d-623b-41ab-afe4-80edc71bb67c">
Nov 15 23:30:11 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 23:30:11 user nova-compute[76391]:         </nova:port>
Nov 15 23:30:11 user nova-compute[76391]:       </nova:ports>
Nov 15 23:30:11 user nova-compute[76391]:     </nova:instance>
Nov 15 23:30:11 user nova-compute[76391]:   </metadata>
Nov 15 23:30:11 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:30:11 user nova-compute[76391]:     <system>
Nov 15 23:30:11 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:30:11 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:30:11 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:30:11 user nova-compute[76391]:       <entry name="serial">6be3d794-c793-4da2-bfa2-8547215014ca</entry>
Nov 15 23:30:11 user nova-compute[76391]:       <entry name="uuid">6be3d794-c793-4da2-bfa2-8547215014ca</entry>
Nov 15 23:30:11 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:30:11 user nova-compute[76391]:     </system>
Nov 15 23:30:11 user nova-compute[76391]:   </sysinfo>
Nov 15 23:30:11 user nova-compute[76391]:   <os>
Nov 15 23:30:11 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:30:11 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:30:11 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:30:11 user nova-compute[76391]:   </os>
Nov 15 23:30:11 user nova-compute[76391]:   <features>
Nov 15 23:30:11 user nova-compute[76391]:     <acpi/>
Nov 15 23:30:11 user nova-compute[76391]:     <apic/>
Nov 15 23:30:11 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:30:11 user nova-compute[76391]:   </features>
Nov 15 23:30:11 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:30:11 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:30:11 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:30:11 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:30:11 user nova-compute[76391]:   </clock>
Nov 15 23:30:11 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:30:11 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:30:11 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:30:11 user nova-compute[76391]:   </cpu>
Nov 15 23:30:11 user nova-compute[76391]:   <devices>
Nov 15 23:30:11 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:30:11 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:30:11 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk"/>
Nov 15 23:30:11 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:30:11 user nova-compute[76391]:     </disk>
Nov 15 23:30:11 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:30:11 user nova-compute[76391]:       <mac address="fa:16:3e:ec:71:f6"/>
Nov 15 23:30:11 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:11 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:30:11 user nova-compute[76391]:       <target dev="tape9b8989d-62"/>
Nov 15 23:30:11 user nova-compute[76391]:     </interface>
Nov 15 23:30:11 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:30:11 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/console.log" append="off"/>
Nov 15 23:30:11 user nova-compute[76391]:     </serial>
Nov 15 23:30:11 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:30:11 user nova-compute[76391]:     <video>
Nov 15 23:30:11 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:11 user nova-compute[76391]:     </video>
Nov 15 23:30:11 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:30:11 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:30:11 user nova-compute[76391]:     </rng>
Nov 15 23:30:11 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:30:11 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:30:11 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:30:11 user nova-compute[76391]:     </memballoon>
Nov 15 23:30:11 user nova-compute[76391]:   </devices>
Nov 15 23:30:11 user nova-compute[76391]: </domain>
Nov 15 23:30:11 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG os_vif [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dddcd68-4d91-56a8-b254-ab6f5f826b2b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b8989d-62, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9b8989d-62, col_values=(('qos', UUID('385498db-af52-44b6-a167-626a7e2c37f8')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9b8989d-62, col_values=(('external_ids', {'iface-id': 'e9b8989d-623b-41ab-afe4-80edc71bb67c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:71:f6', 'vm-uuid': '6be3d794-c793-4da2-bfa2-8547215014ca'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:11 user nova-compute[76391]: INFO os_vif [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62')
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No VIF found with MAC fa:16:3e:ec:71:f6, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.neutron [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updated VIF entry in instance network info cache for port e9b8989d-623b-41ab-afe4-80edc71bb67c. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG nova.network.neutron [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8badb4b-f5b2-45f1-ab15-f799800fb135 req-f7ba8613-7f2d-4123-b27c-441a46d78678 service nova] Releasing lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'flavor' on Instance uuid 745360bd-e3db-4960-870a-ea1889afff5a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:12 user nova-compute[76391]: INFO nova.compute.manager [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Attaching volume f4a5e55a-6b32-4c04-bab0-9b030156cae4 to /dev/vdb
Nov 15 23:30:12 user nova-compute[76391]: DEBUG os_brick.utils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbb5fcc-5462-4af7-bc0e-8da7761bfe6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557e4db-060f-4fa9-b179-9660485a5b10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4fe06e-834c-4cb5-b24c-b2fd0fb5a85f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bbc103-053f-4e28-b9c8-40bbd7b9f3a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:12 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:30:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f7fff-f454-4af0-9498-ff21a692d760]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG os_brick.utils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating existing volume attachment record: 4b4bf931-445b-4358-82a2-1341b0f24d0a {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-deec90e9-5904-4ff3-aab7-c462303ec1fc req-2d335265-b5ea-4ef3-9a10-af65a48b1f6f service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-deec90e9-5904-4ff3-aab7-c462303ec1fc req-2d335265-b5ea-4ef3-9a10-af65a48b1f6f service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-deec90e9-5904-4ff3-aab7-c462303ec1fc req-2d335265-b5ea-4ef3-9a10-af65a48b1f6f service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-deec90e9-5904-4ff3-aab7-c462303ec1fc req-2d335265-b5ea-4ef3-9a10-af65a48b1f6f service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-deec90e9-5904-4ff3-aab7-c462303ec1fc req-2d335265-b5ea-4ef3-9a10-af65a48b1f6f service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:13 user nova-compute[76391]: WARNING nova.compute.manager [req-deec90e9-5904-4ff3-aab7-c462303ec1fc req-2d335265-b5ea-4ef3-9a10-af65a48b1f6f service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state building and task_state spawning.
Nov 15 23:30:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-cfd021b5-48cb-4d50-a7ce-da7f676a230d req-cfc0e91b-4d1a-4d5b-9278-05088f7706c0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cfd021b5-48cb-4d50-a7ce-da7f676a230d req-cfc0e91b-4d1a-4d5b-9278-05088f7706c0 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cfd021b5-48cb-4d50-a7ce-da7f676a230d req-cfc0e91b-4d1a-4d5b-9278-05088f7706c0 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cfd021b5-48cb-4d50-a7ce-da7f676a230d req-cfc0e91b-4d1a-4d5b-9278-05088f7706c0 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-cfd021b5-48cb-4d50-a7ce-da7f676a230d req-cfc0e91b-4d1a-4d5b-9278-05088f7706c0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:15 user nova-compute[76391]: WARNING nova.compute.manager [req-cfd021b5-48cb-4d50-a7ce-da7f676a230d req-cfc0e91b-4d1a-4d5b-9278-05088f7706c0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state building and task_state spawning.
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:30:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance spawned successfully.
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:15 user nova-compute[76391]: INFO nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 15 23:30:15 user nova-compute[76391]: DEBUG nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:30:15 user nova-compute[76391]: INFO nova.compute.manager [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Took 6.87 seconds to build instance.
Nov 15 23:30:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-77b051e1-78a7-4cdf-8648-e83f6d2078b0 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.274s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVEhHOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:30:18 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:30:18 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:30:18 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c50630-72f2-4a5e-a6c7-bd228ec0e182]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:30:18 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dfa5ed-76d6-47ec-8792-23297e51d65d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4] added
Nov 15 23:30:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa9a54-75b6-467f-b291-32a36f90a663]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f98c93f-1e44-4ca2-b042-caf1381f81fd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPVEhHOe {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPVEhHOe" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78894120-1cd6-402e-9ac9-a01e9ddf62f6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPVEhHOe'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7c7fc-961e-4d83-9358-bc2abf6232ee]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[160dee76-938a-417a-8e76-bd1378d19f90]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1f479-f134-4707-832d-8a20ec0ffe13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260]
Nov 15 23:30:18 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260] successful.
Nov 15 23:30:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5165e22-7f32-4736-9051-c26ba88e1c39]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd4d2e-2f4e-4f58-8c6f-5731c30a85c7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2350c3-b116-4043-ae4e-eba3a9728d43]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:30:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVEhHOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26464326531643336', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464326531643336', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'flavor' on Instance uuid 745360bd-e3db-4960-870a-ea1889afff5a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:30:19 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:30:19 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:30:19 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:30:19 user nova-compute[76391]:   <serial>f4a5e55a-6b32-4c04-bab0-9b030156cae4</serial>
Nov 15 23:30:19 user nova-compute[76391]: </disk>
Nov 15 23:30:19 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:30:19 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updating instance_info_cache with network_info: [{"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-bfb44f27-ed01-4f78-a982-5302163e5069" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:30:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] No VIF found with MAC fa:16:3e:f6:0a:91, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:30:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d0d9f986-3469-47be-9052-6a6dcead02a5 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.661s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.013s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing instance network info cache due to event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] Acquiring lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] Acquired lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG nova.network.neutron [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updated VIF entry in instance network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-be944f82-3890-4405-8a03-8be10ba6bdc6 req-bb8e0ee7-ce11-4690-bbe8-49a1a3dad5dd service nova] Releasing lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing instance network info cache due to event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] Acquiring lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] Acquired lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG nova.network.neutron [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:30:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7107MB free_disk=24.829689025878906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:27 user nova-compute[76391]: INFO nova.compute.manager [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Rebooting instance
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Applying migration context for instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b as it has an incoming, in-progress migration 9997678e-d974-4046-a075-27c9a2833dc0. Migration status is finished {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 23:30:27 user nova-compute[76391]: INFO nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating resource usage from migration 9997678e-d974-4046-a075-27c9a2833dc0
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3913ccaf-90f8-4196-bb56-3cee0547dee4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 745360bd-e3db-4960-870a-ea1889afff5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Migration 9997678e-d974-4046-a075-27c9a2833dc0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 63907be3-2f2f-4d5f-921d-20020c1a018b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updated VIF entry in instance network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e696b845-997c-4225-9661-c6bc6e85d505 req-8501ce98-94e7-4ba4-8c53-b2aa52f2891c service nova] Releasing lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquired lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:30:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG nova.network.neutron [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Releasing lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-b67b9be3-c1d4-4c80-9451-49f9b16709c4 req-8c1b4e37-93bb-42d6-8dd3-d78ace688630 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-unplugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b67b9be3-c1d4-4c80-9451-49f9b16709c4 req-8c1b4e37-93bb-42d6-8dd3-d78ace688630 service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b67b9be3-c1d4-4c80-9451-49f9b16709c4 req-8c1b4e37-93bb-42d6-8dd3-d78ace688630 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b67b9be3-c1d4-4c80-9451-49f9b16709c4 req-8c1b4e37-93bb-42d6-8dd3-d78ace688630 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-b67b9be3-c1d4-4c80-9451-49f9b16709c4 req-8c1b4e37-93bb-42d6-8dd3-d78ace688630 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-unplugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:30 user nova-compute[76391]: WARNING nova.compute.manager [req-b67b9be3-c1d4-4c80-9451-49f9b16709c4 req-8c1b4e37-93bb-42d6-8dd3-d78ace688630 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-unplugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state active and task_state reboot_started.
Nov 15 23:30:31 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance shutdown successfully.
Nov 15 23:30:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:30:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:32 user nova-compute[76391]: WARNING nova.compute.manager [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state active and task_state reboot_started.
Nov 15 23:30:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:32 user nova-compute[76391]: WARNING nova.compute.manager [req-7e160f20-8683-420b-b53d-da90486e8560 req-aadc7882-e4e2-4e65-a9ca-f0808745bb6b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state active and task_state reboot_started.
Nov 15 23:30:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Going to confirm migration 2 {{(pid=76391) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquired lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:30:33 user nova-compute[76391]: DEBUG nova.objects.instance [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'info_cache' on Instance uuid e640c20f-d2d0-4b48-b13c-8ee8b1af864b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.network.neutron [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Releasing lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.objects.instance [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'migration_context' on Instance uuid e640c20f-d2d0-4b48-b13c-8ee8b1af864b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.objects.base [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Object Instance<e640c20f-d2d0-4b48-b13c-8ee8b1af864b> lazy-loaded attributes: info_cache,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:34 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance running successfully.
Nov 15 23:30:34 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance soft rebooted successfully.
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.compute.manager [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1ddc9ab4-a6c3-4439-aa61-647576ed27a1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.662s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-059fdf34-1cf4-4855-833a-b6e9c23e67b5 req-039a309f-9b55-4e4f-9bbe-4ce985456702 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-059fdf34-1cf4-4855-833a-b6e9c23e67b5 req-039a309f-9b55-4e4f-9bbe-4ce985456702 service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-059fdf34-1cf4-4855-833a-b6e9c23e67b5 req-039a309f-9b55-4e4f-9bbe-4ce985456702 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-059fdf34-1cf4-4855-833a-b6e9c23e67b5 req-039a309f-9b55-4e4f-9bbe-4ce985456702 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-059fdf34-1cf4-4855-833a-b6e9c23e67b5 req-039a309f-9b55-4e4f-9bbe-4ce985456702 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:34 user nova-compute[76391]: WARNING nova.compute.manager [req-059fdf34-1cf4-4855-833a-b6e9c23e67b5 req-039a309f-9b55-4e4f-9bbe-4ce985456702 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state active and task_state None.
Nov 15 23:30:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.486s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:35 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Deleted allocation for migration 9997678e-d974-4046-a075-27c9a2833dc0
Nov 15 23:30:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-861395a3-f98b-4603-b22b-76667dbabff5 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.402s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:30:35 user nova-compute[76391]: INFO nova.compute.claims [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Claim successful on node user
Nov 15 23:30:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:36 user nova-compute[76391]: INFO nova.compute.manager [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Unshelving
Nov 15 23:30:36 user nova-compute[76391]: INFO nova.virt.block_device [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Booting with volume f256a166-9449-4554-b53c-1810162e9a20 at /dev/vda
Nov 15 23:30:36 user nova-compute[76391]: DEBUG os_brick.utils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f98fa-5ee8-4359-92bb-675cf321b62e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5171f8-51d9-411e-a84a-1439ce5ccf87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[152293df-5fee-48c2-bbff-17e3aa63c15c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a4dd5d-9d3d-4bf7-9ad1-697ef383a6c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:36 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0a7f5b-a318-42bc-8d8a-48eeebf697e8]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG os_brick.utils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating existing volume attachment record: d9d33cb5-e3d7-4caa-a10e-4a87c55fab1e {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.806s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:30:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:30:36 user nova-compute[76391]: DEBUG nova.policy [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7822512a5a344405ad7ec0fe7f3aba35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e478c752c644aebfcbc4db437dfc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:30:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Creating image(s)
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "/opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "/opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "/opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.050s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.210s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.200s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk 1073741824" returned: 0 in 0.061s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Successfully created port: 4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.280s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:30:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Cannot resize image /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Ensure instance console log exists: /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Successfully updated port: 4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquired lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-changed-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Refreshing instance network info cache due to event network-changed-4dc4f699-014c-4290-8c51-16132cfaae83. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] Acquiring lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updating instance_info_cache with network_info: [{"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Releasing lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Instance network_info: |[{"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] Acquired lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.neutron [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Refreshing network info cache for port 4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Start _get_guest_xml network_info=[{"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:30:38 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:38 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1092623807',display_name='tempest-VolumesSnapshotTestJSON-instance-1092623807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1092623807',id=40,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrQ1nd7VxSeCc7mwrS6ComELLnmWTlKdDEXWdkqolX+bfScHUc/BVXrRbMELL6udZIhQ+OhV4Qu2/9AZ/VvUEmGi0BEOWib1bBhiKWv5ytHGHc1VkONR0maMcuzom9stw==',key_name='tempest-keypair-442881919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e478c752c644aebfcbc4db437dfc5e',ramdisk_id='',reservation_id='r-pk4mmd9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2045009250',owner_user_name='tempest-VolumesSnapshotTestJSON-2045009250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7822512a5a344405ad7ec0fe7f3aba35',uuid=049edce7-c82d-49a4-9f7d-ee8f0e054c65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converting VIF {"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=4dc4f699-014c-4290-8c51-16132cfaae83,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc4f699-01') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'pci_devices' on Instance uuid 049edce7-c82d-49a4-9f7d-ee8f0e054c65 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:30:38 user nova-compute[76391]:   <uuid>049edce7-c82d-49a4-9f7d-ee8f0e054c65</uuid>
Nov 15 23:30:38 user nova-compute[76391]:   <name>instance-00000028</name>
Nov 15 23:30:38 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:30:38 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:30:38 user nova-compute[76391]:   <metadata>
Nov 15 23:30:38 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:30:38 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:30:38 user nova-compute[76391]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1092623807</nova:name>
Nov 15 23:30:38 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:30:38</nova:creationTime>
Nov 15 23:30:38 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:30:38 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:30:38 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:30:38 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:30:38 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:30:38 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:30:38 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:30:38 user nova-compute[76391]:       <nova:owner>
Nov 15 23:30:38 user nova-compute[76391]:         <nova:user uuid="7822512a5a344405ad7ec0fe7f3aba35">tempest-VolumesSnapshotTestJSON-2045009250-project-member</nova:user>
Nov 15 23:30:38 user nova-compute[76391]:         <nova:project uuid="82e478c752c644aebfcbc4db437dfc5e">tempest-VolumesSnapshotTestJSON-2045009250</nova:project>
Nov 15 23:30:38 user nova-compute[76391]:       </nova:owner>
Nov 15 23:30:38 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:30:38 user nova-compute[76391]:       <nova:ports>
Nov 15 23:30:38 user nova-compute[76391]:         <nova:port uuid="4dc4f699-014c-4290-8c51-16132cfaae83">
Nov 15 23:30:38 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 23:30:38 user nova-compute[76391]:         </nova:port>
Nov 15 23:30:38 user nova-compute[76391]:       </nova:ports>
Nov 15 23:30:38 user nova-compute[76391]:     </nova:instance>
Nov 15 23:30:38 user nova-compute[76391]:   </metadata>
Nov 15 23:30:38 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:30:38 user nova-compute[76391]:     <system>
Nov 15 23:30:38 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:30:38 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:30:38 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:30:38 user nova-compute[76391]:       <entry name="serial">049edce7-c82d-49a4-9f7d-ee8f0e054c65</entry>
Nov 15 23:30:38 user nova-compute[76391]:       <entry name="uuid">049edce7-c82d-49a4-9f7d-ee8f0e054c65</entry>
Nov 15 23:30:38 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:30:38 user nova-compute[76391]:     </system>
Nov 15 23:30:38 user nova-compute[76391]:   </sysinfo>
Nov 15 23:30:38 user nova-compute[76391]:   <os>
Nov 15 23:30:38 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:30:38 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:30:38 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:30:38 user nova-compute[76391]:   </os>
Nov 15 23:30:38 user nova-compute[76391]:   <features>
Nov 15 23:30:38 user nova-compute[76391]:     <acpi/>
Nov 15 23:30:38 user nova-compute[76391]:     <apic/>
Nov 15 23:30:38 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:30:38 user nova-compute[76391]:   </features>
Nov 15 23:30:38 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:30:38 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:30:38 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:30:38 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:30:38 user nova-compute[76391]:   </clock>
Nov 15 23:30:38 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:30:38 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:30:38 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:30:38 user nova-compute[76391]:   </cpu>
Nov 15 23:30:38 user nova-compute[76391]:   <devices>
Nov 15 23:30:38 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:30:38 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:30:38 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk"/>
Nov 15 23:30:38 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:30:38 user nova-compute[76391]:     </disk>
Nov 15 23:30:38 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:30:38 user nova-compute[76391]:       <mac address="fa:16:3e:65:f9:02"/>
Nov 15 23:30:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:38 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:30:38 user nova-compute[76391]:       <target dev="tap4dc4f699-01"/>
Nov 15 23:30:38 user nova-compute[76391]:     </interface>
Nov 15 23:30:38 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:30:38 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/console.log" append="off"/>
Nov 15 23:30:38 user nova-compute[76391]:     </serial>
Nov 15 23:30:38 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:30:38 user nova-compute[76391]:     <video>
Nov 15 23:30:38 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:38 user nova-compute[76391]:     </video>
Nov 15 23:30:38 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:30:38 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:30:38 user nova-compute[76391]:     </rng>
Nov 15 23:30:38 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:30:38 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:30:38 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:30:38 user nova-compute[76391]:     </memballoon>
Nov 15 23:30:38 user nova-compute[76391]:   </devices>
Nov 15 23:30:38 user nova-compute[76391]: </domain>
Nov 15 23:30:38 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1092623807',display_name='tempest-VolumesSnapshotTestJSON-instance-1092623807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1092623807',id=40,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrQ1nd7VxSeCc7mwrS6ComELLnmWTlKdDEXWdkqolX+bfScHUc/BVXrRbMELL6udZIhQ+OhV4Qu2/9AZ/VvUEmGi0BEOWib1bBhiKWv5ytHGHc1VkONR0maMcuzom9stw==',key_name='tempest-keypair-442881919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e478c752c644aebfcbc4db437dfc5e',ramdisk_id='',reservation_id='r-pk4mmd9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2045009250',owner_user_name='tempest-VolumesSnapshotTestJSON-2045009250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7822512a5a344405ad7ec0fe7f3aba35',uuid=049edce7-c82d-49a4-9f7d-ee8f0e054c65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converting VIF {"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=4dc4f699-014c-4290-8c51-16132cfaae83,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc4f699-01') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG os_vif [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=4dc4f699-014c-4290-8c51-16132cfaae83,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc4f699-01') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daa4c72e-f0bf-5e5d-86ce-bfe1e2567785', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dc4f699-01, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dc4f699-01, col_values=(('qos', UUID('cdc17a85-f9c6-4846-93ad-03cfc25d36fa')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dc4f699-01, col_values=(('external_ids', {'iface-id': '4dc4f699-014c-4290-8c51-16132cfaae83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:f9:02', 'vm-uuid': '049edce7-c82d-49a4-9f7d-ee8f0e054c65'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:38 user nova-compute[76391]: INFO os_vif [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=4dc4f699-014c-4290-8c51-16132cfaae83,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc4f699-01')
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No VIF found with MAC fa:16:3e:65:f9:02, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:30:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updated VIF entry in instance network info cache for port 4dc4f699-014c-4290-8c51-16132cfaae83. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:30:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updating instance_info_cache with network_info: [{"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-35c0fb89-a434-427e-9351-72201a4a76d3 req-54d9bd7b-ad16-40a4-b5ba-9c3ded41016b service nova] Releasing lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-8ded0bdd-e1d3-4dd5-8e1c-3295542a70f8 req-61fefa66-0ef7-4ce5-8b0c-ff128f4bab5c service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8ded0bdd-e1d3-4dd5-8e1c-3295542a70f8 req-61fefa66-0ef7-4ce5-8b0c-ff128f4bab5c service nova] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8ded0bdd-e1d3-4dd5-8e1c-3295542a70f8 req-61fefa66-0ef7-4ce5-8b0c-ff128f4bab5c service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8ded0bdd-e1d3-4dd5-8e1c-3295542a70f8 req-61fefa66-0ef7-4ce5-8b0c-ff128f4bab5c service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-8ded0bdd-e1d3-4dd5-8e1c-3295542a70f8 req-61fefa66-0ef7-4ce5-8b0c-ff128f4bab5c service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] No waiting events found dispatching network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:40 user nova-compute[76391]: WARNING nova.compute.manager [req-8ded0bdd-e1d3-4dd5-8e1c-3295542a70f8 req-61fefa66-0ef7-4ce5-8b0c-ff128f4bab5c service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received unexpected event network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 for instance with vm_state building and task_state spawning.
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'pci_requests' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'numa_topology' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:30:42 user nova-compute[76391]: INFO nova.compute.claims [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Claim successful on node user
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-691e0750-4732-48bc-89d8-c4a0b06db367 req-0b836933-8929-4bab-9e84-56a15c0feb54 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-691e0750-4732-48bc-89d8-c4a0b06db367 req-0b836933-8929-4bab-9e84-56a15c0feb54 service nova] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-691e0750-4732-48bc-89d8-c4a0b06db367 req-0b836933-8929-4bab-9e84-56a15c0feb54 service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-691e0750-4732-48bc-89d8-c4a0b06db367 req-0b836933-8929-4bab-9e84-56a15c0feb54 service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-691e0750-4732-48bc-89d8-c4a0b06db367 req-0b836933-8929-4bab-9e84-56a15c0feb54 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] No waiting events found dispatching network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:42 user nova-compute[76391]: WARNING nova.compute.manager [req-691e0750-4732-48bc-89d8-c4a0b06db367 req-0b836933-8929-4bab-9e84-56a15c0feb54 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received unexpected event network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 for instance with vm_state building and task_state spawning.
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:42 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Instance spawned successfully.
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:30:42 user nova-compute[76391]: INFO nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 15 23:30:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:30:42 user nova-compute[76391]: INFO nova.network.neutron [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating port 49be1bfc-4b91-464c-9ce8-f25d34d5775d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 23:30:42 user nova-compute[76391]: INFO nova.compute.manager [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Took 6.88 seconds to build instance.
Nov 15 23:30:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2d09afd8-7316-42e6-92d2-f2d39d1bee2e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.982s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing instance network info cache due to event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:30:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Creating image(s)
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Ensure instance console log exists: /opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Start _get_guest_xml network_info=[{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94e6e796-afc9-4058-840d-ae77df5ffcc3', 'attached_at': '', 'detached_at': '', 'volume_id': 'f256a166-9449-4554-b53c-1810162e9a20', 'serial': 'f256a166-9449-4554-b53c-1810162e9a20'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'd9d33cb5-e3d7-4caa-a10e-4a87c55fab1e', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.network.neutron [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:43 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:43 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:43 user nova-compute[76391]: DEBUG nova.objects.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Object Instance<94e6e796-afc9-4058-840d-ae77df5ffcc3> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:30:44 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:30:44 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:30:44 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ddeec5-951d-465a-aa59-539d147a2d80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:30:44 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7c561-8ed0-474b-9aee-9b3f9721802a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20] added
Nov 15 23:30:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[954a9d47-51c9-4db2-8375-7fd741716a3b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba3ef0-a7a2-4a1a-8877-f53754ee4cc0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjLsQnBa {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjLsQnBa" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ad3395-eb2d-4a63-aa82-921fbed3072d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjLsQnBa'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf06ac-0307-4cc4-b498-eb86a5a9b8f9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e963d9-6295-4587-a6d2-c4331ce4a023]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a0731-7aaf-45b2-9d73-e16ec0fe677e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]
Nov 15 23:30:44 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.
Nov 15 23:30:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc75b75-063e-44ac-be92-7d2492d183e3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f78977-e2fd-4774-b298-68bcbc94ee35]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:30:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b73106-3e3f-4dd3-86b6-411ec9561ffc]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updated VIF entry in instance network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-69ec6070-79af-4938-b35d-3b0b313f10c3 req-326b3ea3-e459-4f74-992c-9c288a143e23 service nova] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-changed-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Refreshing instance network info cache due to event network-changed-6969b61a-3736-4393-935f-aa33cf7d4b1f. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] Acquiring lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] Acquired lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Refreshing network info cache for port 6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'flavor' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updated VIF entry in instance network info cache for port 6969b61a-3736-4393-935f-aa33cf7d4b1f. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.network.neutron [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updating instance_info_cache with network_info: [{"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dd55a58b-240d-46dd-8145-d5f6f3d46824 req-991d194a-9f72-4efb-be23-1f363b5eb88d service nova] Releasing lock "refresh_cache-63907be3-2f2f-4d5f-921d-20020c1a018b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:45 user nova-compute[76391]: INFO nova.compute.manager [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Attaching volume 509b9acb-f989-4893-8a87-1c717d5bedcd to /dev/vdb
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.utils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2241c5d7-cd4a-40b8-b5c6-f1b57c25f082]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[251c33bf-57f3-4f99-8040-d34655c549f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecfcac7-55ef-4a06-80fc-c65570060ccd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc37a309-cd52-4407-996c-6d232a751c2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:45 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:30:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27892538-13cc-47be-8411-692670df2347]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.utils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updating existing volume attachment record: 62774cfb-fa87-4fb7-840b-a5b2bed910fc {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23732326264363834', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732326264363834', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925434621',display_name='tempest-TestShelveInstance-server-1925434621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925434621',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1887119281',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5db709fa12274eab9402a50013e7db5f',ramdisk_id='',reservation_id='r-ktv3zmaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2043367122',owner_user_name='tempest-TestShelveInstance-2043367122-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:30:36Z,user_data=None,user_id='44386665eb154a26b4a15de6ae2f4ebb',uuid=94e6e796-afc9-4058-840d-ae77df5ffcc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converting VIF {"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.objects.instance [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'pci_devices' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.objects.base [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Object Instance<94e6e796-afc9-4058-840d-ae77df5ffcc3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:30:45 user nova-compute[76391]:   <uuid>94e6e796-afc9-4058-840d-ae77df5ffcc3</uuid>
Nov 15 23:30:45 user nova-compute[76391]:   <name>instance-00000020</name>
Nov 15 23:30:45 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:30:45 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:30:45 user nova-compute[76391]:   <metadata>
Nov 15 23:30:45 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:30:45 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:30:45 user nova-compute[76391]:       <nova:name>tempest-TestShelveInstance-server-1925434621</nova:name>
Nov 15 23:30:45 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:30:43</nova:creationTime>
Nov 15 23:30:45 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:30:45 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:30:45 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:30:45 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:30:45 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:30:45 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:30:45 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:30:45 user nova-compute[76391]:       <nova:owner>
Nov 15 23:30:45 user nova-compute[76391]:         <nova:user uuid="44386665eb154a26b4a15de6ae2f4ebb">tempest-TestShelveInstance-2043367122-project-member</nova:user>
Nov 15 23:30:45 user nova-compute[76391]:         <nova:project uuid="5db709fa12274eab9402a50013e7db5f">tempest-TestShelveInstance-2043367122</nova:project>
Nov 15 23:30:45 user nova-compute[76391]:       </nova:owner>
Nov 15 23:30:45 user nova-compute[76391]:       <nova:ports>
Nov 15 23:30:45 user nova-compute[76391]:         <nova:port uuid="49be1bfc-4b91-464c-9ce8-f25d34d5775d">
Nov 15 23:30:45 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:30:45 user nova-compute[76391]:         </nova:port>
Nov 15 23:30:45 user nova-compute[76391]:       </nova:ports>
Nov 15 23:30:45 user nova-compute[76391]:     </nova:instance>
Nov 15 23:30:45 user nova-compute[76391]:   </metadata>
Nov 15 23:30:45 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:30:45 user nova-compute[76391]:     <system>
Nov 15 23:30:45 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:30:45 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:30:45 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:30:45 user nova-compute[76391]:       <entry name="serial">94e6e796-afc9-4058-840d-ae77df5ffcc3</entry>
Nov 15 23:30:45 user nova-compute[76391]:       <entry name="uuid">94e6e796-afc9-4058-840d-ae77df5ffcc3</entry>
Nov 15 23:30:45 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:30:45 user nova-compute[76391]:     </system>
Nov 15 23:30:45 user nova-compute[76391]:   </sysinfo>
Nov 15 23:30:45 user nova-compute[76391]:   <os>
Nov 15 23:30:45 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:30:45 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:30:45 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:30:45 user nova-compute[76391]:   </os>
Nov 15 23:30:45 user nova-compute[76391]:   <features>
Nov 15 23:30:45 user nova-compute[76391]:     <acpi/>
Nov 15 23:30:45 user nova-compute[76391]:     <apic/>
Nov 15 23:30:45 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:30:45 user nova-compute[76391]:   </features>
Nov 15 23:30:45 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:30:45 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:30:45 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:30:45 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:30:45 user nova-compute[76391]:   </clock>
Nov 15 23:30:45 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:30:45 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:30:45 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:30:45 user nova-compute[76391]:   </cpu>
Nov 15 23:30:45 user nova-compute[76391]:   <devices>
Nov 15 23:30:45 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:30:45 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:30:45 user nova-compute[76391]:       <source dev="/dev/sdf"/>
Nov 15 23:30:45 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:30:45 user nova-compute[76391]:       <serial>f256a166-9449-4554-b53c-1810162e9a20</serial>
Nov 15 23:30:45 user nova-compute[76391]:     </disk>
Nov 15 23:30:45 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:30:45 user nova-compute[76391]:       <mac address="fa:16:3e:c2:1e:59"/>
Nov 15 23:30:45 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:45 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:30:45 user nova-compute[76391]:       <target dev="tap49be1bfc-4b"/>
Nov 15 23:30:45 user nova-compute[76391]:     </interface>
Nov 15 23:30:45 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:30:45 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3/console.log" append="off"/>
Nov 15 23:30:45 user nova-compute[76391]:     </serial>
Nov 15 23:30:45 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:30:45 user nova-compute[76391]:     <video>
Nov 15 23:30:45 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:45 user nova-compute[76391]:     </video>
Nov 15 23:30:45 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:30:45 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:30:45 user nova-compute[76391]:     </rng>
Nov 15 23:30:45 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:30:45 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:30:45 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:30:45 user nova-compute[76391]:     </memballoon>
Nov 15 23:30:45 user nova-compute[76391]:   </devices>
Nov 15 23:30:45 user nova-compute[76391]: </domain>
Nov 15 23:30:45 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925434621',display_name='tempest-TestShelveInstance-server-1925434621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925434621',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1887119281',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5db709fa12274eab9402a50013e7db5f',ramdisk_id='',reservation_id='r-ktv3zmaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2043367122',owner_user_name='tempest-TestShelveInstance-2043367122-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:30:36Z,user_data=None,user_id='44386665eb154a26b4a15de6ae2f4ebb',uuid=94e6e796-afc9-4058-840d-ae77df5ffcc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converting VIF {"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG os_vif [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '878d160c-4a2a-5c64-84bc-2bed8ea37261', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49be1bfc-4b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49be1bfc-4b, col_values=(('qos', UUID('4d87c7a6-f9de-4d8d-a653-4a21d03d70ea')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49be1bfc-4b, col_values=(('external_ids', {'iface-id': '49be1bfc-4b91-464c-9ce8-f25d34d5775d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:1e:59', 'vm-uuid': '94e6e796-afc9-4058-840d-ae77df5ffcc3'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:45 user nova-compute[76391]: INFO os_vif [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b')
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] No VIF found with MAC fa:16:3e:c2:1e:59, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:30:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-edcad225-37b1-4380-8b07-3a2d9e906427 req-8a7cac6f-a1bc-497a-bdeb-419f06c3418d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-edcad225-37b1-4380-8b07-3a2d9e906427 req-8a7cac6f-a1bc-497a-bdeb-419f06c3418d service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-edcad225-37b1-4380-8b07-3a2d9e906427 req-8a7cac6f-a1bc-497a-bdeb-419f06c3418d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-edcad225-37b1-4380-8b07-3a2d9e906427 req-8a7cac6f-a1bc-497a-bdeb-419f06c3418d service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-edcad225-37b1-4380-8b07-3a2d9e906427 req-8a7cac6f-a1bc-497a-bdeb-419f06c3418d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:47 user nova-compute[76391]: WARNING nova.compute.manager [req-edcad225-37b1-4380-8b07-3a2d9e906427 req-8a7cac6f-a1bc-497a-bdeb-419f06c3418d service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 23:30:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:30:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:30:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance spawned successfully.
Nov 15 23:30:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:30:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b377a77-7244-4a42-9c41-d9cbe972922d req-5f38ff38-e67f-45ff-af6e-7f8a89906c05 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b377a77-7244-4a42-9c41-d9cbe972922d req-5f38ff38-e67f-45ff-af6e-7f8a89906c05 service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b377a77-7244-4a42-9c41-d9cbe972922d req-5f38ff38-e67f-45ff-af6e-7f8a89906c05 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b377a77-7244-4a42-9c41-d9cbe972922d req-5f38ff38-e67f-45ff-af6e-7f8a89906c05 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b377a77-7244-4a42-9c41-d9cbe972922d req-5f38ff38-e67f-45ff-af6e-7f8a89906c05 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:30:49 user nova-compute[76391]: WARNING nova.compute.manager [req-9b377a77-7244-4a42-9c41-d9cbe972922d req-5f38ff38-e67f-45ff-af6e-7f8a89906c05 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 23:30:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-be7123a1-9df5-48ce-9cff-d962bcc5cda8 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.294s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIXwpQKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:30:50 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:30:50 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:30:50 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d47bee-99fa-4268-bfd1-d7f11d3b2bcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:30:50 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f04026-43b4-462c-b468-bfc91681cdd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd] added
Nov 15 23:30:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33904349-241c-4efe-b288-971db8d43f5d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd0bb5a-5d8e-4c4c-b039-f59a84595f60]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIXwpQKk {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIXwpQKk" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7b0dd-b9be-4c35-a163-5ca4635b6cb9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xIXwpQKk'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489fa46-5038-4eb1-901a-6419b676b931]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ec7d7-c8af-4e6e-aa65-768d858e10b2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb9268e-036e-4355-bd42-0d70cdb043fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260]
Nov 15 23:30:51 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260] successful.
Nov 15 23:30:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f27e00-aa8e-4e60-874b-c9e2950b0aa1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63da421-9886-4d76-942f-eb1e5a9ca1d1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:30:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:30:51 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:30:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb63306-d207-45ee-b816-3526e5c1ab02]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:30:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIXwpQKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23934386533386139', 'path': '/dev/sdh'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934386533386139', 'path': '/dev/sdh'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'flavor' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:30:52 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:30:52 user nova-compute[76391]:   <source dev="/dev/sdh"/>
Nov 15 23:30:52 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:30:52 user nova-compute[76391]:   <serial>509b9acb-f989-4893-8a87-1c717d5bedcd</serial>
Nov 15 23:30:52 user nova-compute[76391]: </disk>
Nov 15 23:30:52 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No VIF found with MAC fa:16:3e:10:70:3c, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:30:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdf74e86-bab3-4adf-b7d2-0cf8a51d9f3a tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.587s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG nova.objects.instance [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'flavor' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:56 user nova-compute[76391]: INFO nova.compute.manager [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Attaching volume 91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 to /dev/vdc
Nov 15 23:30:56 user nova-compute[76391]: DEBUG os_brick.utils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac924740-027e-4551-90d7-3441a7af3698]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a22d4f-d533-480a-bc14-372afb6ff3f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d063a4-796d-46ff-b937-ae461d2d0110]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10711e5e-43eb-4810-a6ff-875c2ffb037a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:30:56 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f36be6-0aa0-43ae-8200-89ad7f5885e9]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG os_brick.utils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updating existing volume attachment record: 6111e990-ce46-4e4a-8092-ec09ebe3089b {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:56 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:30:56 user nova-compute[76391]: INFO nova.compute.claims [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Claim successful on node user
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.network.neutron [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:30:57 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.policy [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a0dc5a4052f4e9ebf3448d0ed5e5f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0d9ceea4a4748c4a4524ffb24a56e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:30:57 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Creating image(s)
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "/opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "/opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk 1073741824" returned: 0 in 0.049s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG nova.network.neutron [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Successfully created port: d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Cannot resize image /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Ensure instance console log exists: /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:30:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.neutron [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Successfully updated port: d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquired lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.neutron [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-changed-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Refreshing instance network info cache due to event network-changed-d876d1a1-206d-4400-a2c5-1e2cbfa0589d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] Acquiring lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.neutron [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.neutron [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updating instance_info_cache with network_info: [{"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Releasing lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Instance network_info: |[{"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] Acquired lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.neutron [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Refreshing network info cache for port d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Start _get_guest_xml network_info=[{"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:30:59 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:59 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-322522751',display_name='tempest-AttachVolumeNegativeTest-server-322522751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-322522751',id=41,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6qxqW95iiT/Fq2AXyx2ZAOkeNO2q3YLDdcLGXkFfv3RRxcmmPYmfzUC0KLW8BrsDM3AEukJE/RA2NKZcLlD8WVbenHv2OTzWoDXAJFjehOdjypEIHk+8F6Bzr9YaDaSw==',key_name='tempest-keypair-2064401305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-ymq6ka2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=3489fe22-21c6-4d85-9dca-8bb8d89212dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:fc:f0,bridge_name='br-int',has_traffic_filtering=True,id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd876d1a1-20') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.objects.instance [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'pci_devices' on Instance uuid 3489fe22-21c6-4d85-9dca-8bb8d89212dc {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:30:59 user nova-compute[76391]:   <uuid>3489fe22-21c6-4d85-9dca-8bb8d89212dc</uuid>
Nov 15 23:30:59 user nova-compute[76391]:   <name>instance-00000029</name>
Nov 15 23:30:59 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:30:59 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:30:59 user nova-compute[76391]:   <metadata>
Nov 15 23:30:59 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:30:59 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:30:59 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-322522751</nova:name>
Nov 15 23:30:59 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:30:59</nova:creationTime>
Nov 15 23:30:59 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:30:59 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:30:59 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:30:59 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:30:59 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:30:59 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:30:59 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:30:59 user nova-compute[76391]:       <nova:owner>
Nov 15 23:30:59 user nova-compute[76391]:         <nova:user uuid="9a0dc5a4052f4e9ebf3448d0ed5e5f2a">tempest-AttachVolumeNegativeTest-511423013-project-member</nova:user>
Nov 15 23:30:59 user nova-compute[76391]:         <nova:project uuid="f0d9ceea4a4748c4a4524ffb24a56e97">tempest-AttachVolumeNegativeTest-511423013</nova:project>
Nov 15 23:30:59 user nova-compute[76391]:       </nova:owner>
Nov 15 23:30:59 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:30:59 user nova-compute[76391]:       <nova:ports>
Nov 15 23:30:59 user nova-compute[76391]:         <nova:port uuid="d876d1a1-206d-4400-a2c5-1e2cbfa0589d">
Nov 15 23:30:59 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 23:30:59 user nova-compute[76391]:         </nova:port>
Nov 15 23:30:59 user nova-compute[76391]:       </nova:ports>
Nov 15 23:30:59 user nova-compute[76391]:     </nova:instance>
Nov 15 23:30:59 user nova-compute[76391]:   </metadata>
Nov 15 23:30:59 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:30:59 user nova-compute[76391]:     <system>
Nov 15 23:30:59 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:30:59 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:30:59 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:30:59 user nova-compute[76391]:       <entry name="serial">3489fe22-21c6-4d85-9dca-8bb8d89212dc</entry>
Nov 15 23:30:59 user nova-compute[76391]:       <entry name="uuid">3489fe22-21c6-4d85-9dca-8bb8d89212dc</entry>
Nov 15 23:30:59 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:30:59 user nova-compute[76391]:     </system>
Nov 15 23:30:59 user nova-compute[76391]:   </sysinfo>
Nov 15 23:30:59 user nova-compute[76391]:   <os>
Nov 15 23:30:59 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:30:59 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:30:59 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:30:59 user nova-compute[76391]:   </os>
Nov 15 23:30:59 user nova-compute[76391]:   <features>
Nov 15 23:30:59 user nova-compute[76391]:     <acpi/>
Nov 15 23:30:59 user nova-compute[76391]:     <apic/>
Nov 15 23:30:59 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:30:59 user nova-compute[76391]:   </features>
Nov 15 23:30:59 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:30:59 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:30:59 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:30:59 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:30:59 user nova-compute[76391]:   </clock>
Nov 15 23:30:59 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:30:59 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:30:59 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:30:59 user nova-compute[76391]:   </cpu>
Nov 15 23:30:59 user nova-compute[76391]:   <devices>
Nov 15 23:30:59 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:30:59 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:30:59 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk"/>
Nov 15 23:30:59 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:30:59 user nova-compute[76391]:     </disk>
Nov 15 23:30:59 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:30:59 user nova-compute[76391]:       <mac address="fa:16:3e:92:fc:f0"/>
Nov 15 23:30:59 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:59 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:30:59 user nova-compute[76391]:       <target dev="tapd876d1a1-20"/>
Nov 15 23:30:59 user nova-compute[76391]:     </interface>
Nov 15 23:30:59 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:30:59 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/console.log" append="off"/>
Nov 15 23:30:59 user nova-compute[76391]:     </serial>
Nov 15 23:30:59 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:30:59 user nova-compute[76391]:     <video>
Nov 15 23:30:59 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:30:59 user nova-compute[76391]:     </video>
Nov 15 23:30:59 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:30:59 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:30:59 user nova-compute[76391]:     </rng>
Nov 15 23:30:59 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:30:59 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:30:59 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:30:59 user nova-compute[76391]:     </memballoon>
Nov 15 23:30:59 user nova-compute[76391]:   </devices>
Nov 15 23:30:59 user nova-compute[76391]: </domain>
Nov 15 23:30:59 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-322522751',display_name='tempest-AttachVolumeNegativeTest-server-322522751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-322522751',id=41,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6qxqW95iiT/Fq2AXyx2ZAOkeNO2q3YLDdcLGXkFfv3RRxcmmPYmfzUC0KLW8BrsDM3AEukJE/RA2NKZcLlD8WVbenHv2OTzWoDXAJFjehOdjypEIHk+8F6Bzr9YaDaSw==',key_name='tempest-keypair-2064401305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-ymq6ka2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:30:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=3489fe22-21c6-4d85-9dca-8bb8d89212dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:fc:f0,bridge_name='br-int',has_traffic_filtering=True,id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd876d1a1-20') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG os_vif [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:fc:f0,bridge_name='br-int',has_traffic_filtering=True,id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd876d1a1-20') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:30:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3608fad7-4179-5114-8a54-faef4522ed00', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd876d1a1-20, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd876d1a1-20, col_values=(('qos', UUID('0211fb9a-b467-4c24-9059-70abcaf452b9')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd876d1a1-20, col_values=(('external_ids', {'iface-id': 'd876d1a1-206d-4400-a2c5-1e2cbfa0589d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:fc:f0', 'vm-uuid': '3489fe22-21c6-4d85-9dca-8bb8d89212dc'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:00 user nova-compute[76391]: INFO os_vif [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:fc:f0,bridge_name='br-int',has_traffic_filtering=True,id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd876d1a1-20')
Nov 15 23:31:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No VIF found with MAC fa:16:3e:92:fc:f0, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG nova.network.neutron [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updated VIF entry in instance network info cache for port d876d1a1-206d-4400-a2c5-1e2cbfa0589d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG nova.network.neutron [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updating instance_info_cache with network_info: [{"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96dc3cd9-3090-43bf-827a-a460a29ff52f req-bf4dd5a4-5f23-4126-8caa-b390412c0262 service nova] Releasing lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:31:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-0b00220b-3089-466f-986a-2d192daa2954 req-ec9b9458-eb1b-4a34-86c1-aee6b47939c2 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0b00220b-3089-466f-986a-2d192daa2954 req-ec9b9458-eb1b-4a34-86c1-aee6b47939c2 service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0b00220b-3089-466f-986a-2d192daa2954 req-ec9b9458-eb1b-4a34-86c1-aee6b47939c2 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0b00220b-3089-466f-986a-2d192daa2954 req-ec9b9458-eb1b-4a34-86c1-aee6b47939c2 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-0b00220b-3089-466f-986a-2d192daa2954 req-ec9b9458-eb1b-4a34-86c1-aee6b47939c2 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:01 user nova-compute[76391]: WARNING nova.compute.manager [req-0b00220b-3089-466f-986a-2d192daa2954 req-ec9b9458-eb1b-4a34-86c1-aee6b47939c2 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received unexpected event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with vm_state building and task_state spawning.
Nov 15 23:31:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeLlparE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:31:02 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:31:02 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:31:02 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc5faac-2ee1-4ee3-8d37-45ea41327cbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:31:02 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6603553b-886b-4553-857b-7d3be27970ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5] added
Nov 15 23:31:02 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac8e17e-1806-4ef4-8fb4-3cdabfc62b58]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c8bb35-6110-45a8-ae7a-a8af75646210]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeLlparE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeLlparE" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591e8fd-d7b5-4683-8741-56dab2bdacc4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KeLlparE'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[382e5429-3cdf-46cf-8af4-d99dfd2ec10d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa973774-4477-4b26-a572-d16f3b519266]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c03da9d-1da7-454c-95f0-91698953c6b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260]
Nov 15 23:31:02 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260] successful.
Nov 15 23:31:02 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c101dc06-4922-44ed-9700-78f3cade7fe5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0306860d-3b66-4d6d-a829-83e5a8a35fb1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:31:02 user nova-compute[76391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 (non-flash)
Nov 15 23:31:02 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] HCTL ('40', '-', '-', 0) found on session 41 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c216eb3-bedf-4bdf-88d4-4d53c05768eb]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Searching for a device in session 41 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:31:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeLlparE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26634376164343534', 'path': '/dev/sdi'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634376164343534', 'path': '/dev/sdi'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.objects.instance [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'flavor' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:31:03 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:31:03 user nova-compute[76391]:   <source dev="/dev/sdi"/>
Nov 15 23:31:03 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:31:03 user nova-compute[76391]:   <serial>91d1c983-8b8e-4223-a66a-3fd8b4fe92d5</serial>
Nov 15 23:31:03 user nova-compute[76391]: </disk>
Nov 15 23:31:03 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:31:03 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Instance spawned successfully.
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-b21ec0f8-db40-4251-92e3-b4c9dfcd0c3d req-208a5b6e-725f-4163-8f3d-de190a400333 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b21ec0f8-db40-4251-92e3-b4c9dfcd0c3d req-208a5b6e-725f-4163-8f3d-de190a400333 service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b21ec0f8-db40-4251-92e3-b4c9dfcd0c3d req-208a5b6e-725f-4163-8f3d-de190a400333 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b21ec0f8-db40-4251-92e3-b4c9dfcd0c3d req-208a5b6e-725f-4163-8f3d-de190a400333 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-b21ec0f8-db40-4251-92e3-b4c9dfcd0c3d req-208a5b6e-725f-4163-8f3d-de190a400333 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:03 user nova-compute[76391]: WARNING nova.compute.manager [req-b21ec0f8-db40-4251-92e3-b4c9dfcd0c3d req-208a5b6e-725f-4163-8f3d-de190a400333 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received unexpected event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with vm_state building and task_state spawning.
Nov 15 23:31:03 user nova-compute[76391]: INFO nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 15 23:31:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:31:04 user nova-compute[76391]: INFO nova.compute.manager [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Took 7.19 seconds to build instance.
Nov 15 23:31:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:31:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:31:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:31:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] No VIF found with MAC fa:16:3e:10:70:3c, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:31:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-42bc2feb-00d2-4caf-a875-0b81386d8bd8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.355s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-41605019-c3fc-42b0-9587-258ebc47f0e2 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.576s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:05 user nova-compute[76391]: INFO nova.compute.manager [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Detaching volume 91d1c983-8b8e-4223-a66a-3fd8b4fe92d5
Nov 15 23:31:05 user nova-compute[76391]: INFO nova.virt.block_device [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Attempting to driver detach volume 91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 from mountpoint /dev/vdc
Nov 15 23:31:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Attempting to detach device vdc from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:31:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:31:05 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:31:05 user nova-compute[76391]:   <source dev="/dev/sdi"/>
Nov 15 23:31:05 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:31:05 user nova-compute[76391]:   <serial>91d1c983-8b8e-4223-a66a-3fd8b4fe92d5</serial>
Nov 15 23:31:05 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 23:31:05 user nova-compute[76391]: </disk>
Nov 15 23:31:05 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:31:05 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Successfully detached device vdc from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the persistent domain config.
Nov 15 23:31:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:31:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:31:05 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:31:05 user nova-compute[76391]:   <source dev="/dev/sdi"/>
Nov 15 23:31:05 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:31:05 user nova-compute[76391]:   <serial>91d1c983-8b8e-4223-a66a-3fd8b4fe92d5</serial>
Nov 15 23:31:05 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 23:31:05 user nova-compute[76391]: </disk>
Nov 15 23:31:05 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:31:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:31:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updating instance_info_cache with network_info: [{"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-d1c8427a-7299-4332-82eb-afc545cb6f8d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:31:19 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:31:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:25 user nova-compute[76391]: INFO nova.compute.manager [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Unrescuing
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquired lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:31:25 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 63907be3-2f2f-4d5f-921d-20020c1a018b is timed out.
Nov 15 23:31:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Successfully detached device vdc from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the live domain config.
Nov 15 23:31:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeLlparE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:31:26 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec46fdb-7d79-43f0-ad20-cfe4b479898b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:31:26 user nova-compute[76391]: No targets found.
Nov 15 23:31:26 user nova-compute[76391]: iSNS:
Nov 15 23:31:26 user nova-compute[76391]: No targets found.
Nov 15 23:31:26 user nova-compute[76391]: STATIC:
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5
Nov 15 23:31:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:31:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:31:26 user nova-compute[76391]: FIRMWARE:
Nov 15 23:31:26 user nova-compute[76391]: No targets found.
Nov 15 23:31:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:31:26 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:31:26 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c626bdd-31ea-4afd-a7ba-6e6c61490b5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[557338e3-67b5-4256-b4ae-37f96e558286]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:31:26 user nova-compute[76391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 (non-flash)
Nov 15 23:31:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740596f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5'): ({'sdi'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Removing single pathed devices sdi {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396318a-b6d3-43f7-bacf-7f27fab2be91]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df3ab19-e3c6-44e0-bfd5-b523e00a4959]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Flushing IO for device /dev/sdi {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6bee84-c3fc-4751-80bc-4c7aede8f9b7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Updating instance_info_cache with network_info: [{"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Releasing lock "refresh_cache-3913ccaf-90f8-4196-bb56-3cee0547dee4" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'flavor' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd84b37c-3db2-4933-95d1-a64602d29aff]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] SCSI volumes sdi have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8ca0bf-524c-4742-90c0-b7c7d635fba8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ee126-9469-4b23-a548-cae1b5b2e996]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260]
Nov 15 23:31:26 user nova-compute[76391]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5, portal: 172.16.0.220,3260] successful.
Nov 15 23:31:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1c983-8b8e-4223-a66a-3fd8b4fe92d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3aba8-08fe-4cc6-857d-754f9eee1ef9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] <== disconnect_volume: return (494ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-e6f0c247-4465-40b0-94c4-9ae720de9993 req-f876ef11-3bd3-4f35-b3ef-bcf537243c4a service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e6f0c247-4465-40b0-94c4-9ae720de9993 req-f876ef11-3bd3-4f35-b3ef-bcf537243c4a service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e6f0c247-4465-40b0-94c4-9ae720de9993 req-f876ef11-3bd3-4f35-b3ef-bcf537243c4a service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e6f0c247-4465-40b0-94c4-9ae720de9993 req-f876ef11-3bd3-4f35-b3ef-bcf537243c4a service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-e6f0c247-4465-40b0-94c4-9ae720de9993 req-f876ef11-3bd3-4f35-b3ef-bcf537243c4a service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:26 user nova-compute[76391]: WARNING nova.compute.manager [req-e6f0c247-4465-40b0-94c4-9ae720de9993 req-f876ef11-3bd3-4f35-b3ef-bcf537243c4a service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.objects.instance [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'flavor' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:31:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:31:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6540MB free_disk=24.73114776611328GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance destroyed successfully.
Nov 15 23:31:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-57192e58-6af5-418b-b0bb-816a057ca2aa tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.087s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3913ccaf-90f8-4196-bb56-3cee0547dee4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 745360bd-e3db-4960-870a-ea1889afff5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 63907be3-2f2f-4d5f-921d-20020c1a018b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 94e6e796-afc9-4058-840d-ae77df5ffcc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:31:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-484dae70-885e-4aa3-9c33-1746f1319b01 req-36654f7a-ad98-46b0-a48c-2ce826123399 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-484dae70-885e-4aa3-9c33-1746f1319b01 req-36654f7a-ad98-46b0-a48c-2ce826123399 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-484dae70-885e-4aa3-9c33-1746f1319b01 req-36654f7a-ad98-46b0-a48c-2ce826123399 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-484dae70-885e-4aa3-9c33-1746f1319b01 req-36654f7a-ad98-46b0-a48c-2ce826123399 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-484dae70-885e-4aa3-9c33-1746f1319b01 req-36654f7a-ad98-46b0-a48c-2ce826123399 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:28 user nova-compute[76391]: WARNING nova.compute.manager [req-484dae70-885e-4aa3-9c33-1746f1319b01 req-36654f7a-ad98-46b0-a48c-2ce826123399 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 6626d0d5-79ae-433b-aa6f-94e69353c7d3 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 0c0d5ecf-3d9e-4715-87a4-16726b37f10c {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid e640c20f-d2d0-4b48-b13c-8ee8b1af864b {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 745360bd-e3db-4960-870a-ea1889afff5a {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 049edce7-c82d-49a4-9f7d-ee8f0e054c65 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 3489fe22-21c6-4d85-9dca-8bb8d89212dc {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: INFO nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "745360bd-e3db-4960-870a-ea1889afff5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "745360bd-e3db-4960-870a-ea1889afff5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:30 user nova-compute[76391]: WARNING nova.compute.manager [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:30 user nova-compute[76391]: WARNING nova.compute.manager [req-b4b1bfd2-8018-47a6-9b50-74756ab5d0ed req-20a01cda-8adb-4180-a69c-3f4882cfe90f service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e5311244-545a-4cc0-85a6-958eb9895228 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:31:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:31:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:31:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:31:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:43 user nova-compute[76391]: INFO nova.compute.manager [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Unrescuing
Nov 15 23:31:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:31:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquired lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:31:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:31:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:31:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Releasing lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:31:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'flavor' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:31:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-4d566d7a-222b-485b-92b3-8249941bec06 req-7b9161ae-a487-4bf4-9444-a551eb418c4d service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4d566d7a-222b-485b-92b3-8249941bec06 req-7b9161ae-a487-4bf4-9444-a551eb418c4d service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4d566d7a-222b-485b-92b3-8249941bec06 req-7b9161ae-a487-4bf4-9444-a551eb418c4d service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4d566d7a-222b-485b-92b3-8249941bec06 req-7b9161ae-a487-4bf4-9444-a551eb418c4d service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-4d566d7a-222b-485b-92b3-8249941bec06 req-7b9161ae-a487-4bf4-9444-a551eb418c4d service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:44 user nova-compute[76391]: WARNING nova.compute.manager [req-4d566d7a-222b-485b-92b3-8249941bec06 req-7b9161ae-a487-4bf4-9444-a551eb418c4d service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance destroyed successfully.
Nov 15 23:31:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:46 user nova-compute[76391]: WARNING nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:46 user nova-compute[76391]: WARNING nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:46 user nova-compute[76391]: WARNING nova.compute.manager [req-d42edc16-674b-4422-ad1c-2effff388cc9 req-eea1fa17-0c9a-446b-aeaa-7362014bee24 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state rescued and task_state unrescuing.
Nov 15 23:31:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d2f28b9c-dd35-49fa-8a86-65ac573845cf tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing instance network info cache due to event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] Acquiring lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] Acquired lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updated VIF entry in instance network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:31:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8bb2e49e-a7ba-47c9-8d93-fa38dd3aecfb req-5c4f0dc4-80cd-4e2e-a635-9ab390502d5d service nova] Releasing lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:54 user nova-compute[76391]: INFO nova.compute.manager [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Shelving
Nov 15 23:31:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-19bad19d-22f6-4180-a6c5-004b4a3a248c req-1c957903-cf2f-4131-99c7-51637b7c3550 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-unplugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-19bad19d-22f6-4180-a6c5-004b4a3a248c req-1c957903-cf2f-4131-99c7-51637b7c3550 service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-19bad19d-22f6-4180-a6c5-004b4a3a248c req-1c957903-cf2f-4131-99c7-51637b7c3550 service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-19bad19d-22f6-4180-a6c5-004b4a3a248c req-1c957903-cf2f-4131-99c7-51637b7c3550 service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-19bad19d-22f6-4180-a6c5-004b4a3a248c req-1c957903-cf2f-4131-99c7-51637b7c3550 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-unplugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:54 user nova-compute[76391]: WARNING nova.compute.manager [req-19bad19d-22f6-4180-a6c5-004b4a3a248c req-1c957903-cf2f-4131-99c7-51637b7c3550 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received unexpected event network-vif-unplugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with vm_state active and task_state shelving.
Nov 15 23:31:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance destroyed successfully.
Nov 15 23:31:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Beginning cold snapshot process
Nov 15 23:31:54 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:31:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk /opt/stack/data/nova/instances/snapshots/tmp_llmomvt/0bdd09869b13485d8511061d3e6de442 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:31:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk /opt/stack/data/nova/instances/snapshots/tmp_llmomvt/0bdd09869b13485d8511061d3e6de442" returned: 0 in 0.573s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:31:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Snapshot extracted, beginning image upload
Nov 15 23:31:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:56 user nova-compute[76391]: INFO nova.compute.manager [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Detaching volume 509b9acb-f989-4893-8a87-1c717d5bedcd
Nov 15 23:31:56 user nova-compute[76391]: INFO nova.virt.block_device [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Attempting to driver detach volume 509b9acb-f989-4893-8a87-1c717d5bedcd from mountpoint /dev/vdb
Nov 15 23:31:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Attempting to detach device vdb from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:31:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:31:56 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:31:56 user nova-compute[76391]:   <source dev="/dev/sdh"/>
Nov 15 23:31:56 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:31:56 user nova-compute[76391]:   <serial>509b9acb-f989-4893-8a87-1c717d5bedcd</serial>
Nov 15 23:31:56 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:31:56 user nova-compute[76391]: </disk>
Nov 15 23:31:56 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:31:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Successfully detached device vdb from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the persistent domain config.
Nov 15 23:31:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:31:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:31:56 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:31:56 user nova-compute[76391]:   <source dev="/dev/sdh"/>
Nov 15 23:31:56 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:31:56 user nova-compute[76391]:   <serial>509b9acb-f989-4893-8a87-1c717d5bedcd</serial>
Nov 15 23:31:56 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:31:56 user nova-compute[76391]: </disk>
Nov 15 23:31:56 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:31:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-61406850-877c-411f-b6bb-996fda2976f0 req-b6b210b8-79dc-4434-8128-23d2249486fe service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-61406850-877c-411f-b6bb-996fda2976f0 req-b6b210b8-79dc-4434-8128-23d2249486fe service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-61406850-877c-411f-b6bb-996fda2976f0 req-b6b210b8-79dc-4434-8128-23d2249486fe service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-61406850-877c-411f-b6bb-996fda2976f0 req-b6b210b8-79dc-4434-8128-23d2249486fe service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:31:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-61406850-877c-411f-b6bb-996fda2976f0 req-b6b210b8-79dc-4434-8128-23d2249486fe service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:31:56 user nova-compute[76391]: WARNING nova.compute.manager [req-61406850-877c-411f-b6bb-996fda2976f0 req-b6b210b8-79dc-4434-8128-23d2249486fe service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received unexpected event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 23:31:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:31:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Snapshot image upload complete
Nov 15 23:31:58 user nova-compute[76391]: DEBUG nova.compute.manager [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:31:58 user nova-compute[76391]: INFO nova.compute.manager [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Shelve offloading
Nov 15 23:31:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance destroyed successfully.
Nov 15 23:31:58 user nova-compute[76391]: DEBUG nova.compute.manager [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:31:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:31:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquired lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:31:58 user nova-compute[76391]: DEBUG nova.network.neutron [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:31:58 user nova-compute[76391]: DEBUG nova.network.neutron [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:31:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Releasing lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-changed-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Refreshing instance network info cache due to event network-changed-e9b8989d-623b-41ab-afe4-80edc71bb67c. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] Acquiring lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] Acquired lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.network.neutron [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Refreshing network info cache for port e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:31:59 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance destroyed successfully.
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.objects.instance [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'resources' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1243535592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1243535592',id=38,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdbfGGv5EeyneUZURLXjRY2yTJ9CO3AUtVZfrZykUhK+aboka7jRiPibMIDsnB6QsaVUABdNRiFp9ZCGnjTWZI/H4y1pZkfK0sb54p1ToZcJn51z96MAbQ9FbGzZ+df7Q==',key_name='tempest-keypair-1914316400',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-4xpnjva7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member',shelved_at='2023-11-15T23:31:58.278610',shelved_host='user',shelved_image_id='0de1950d-c13c-426a-a925-2914a9cc8aac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=80a0c2c9-85a3-4895-b5d8-8544e44a4f6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG os_vif [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing instance network info cache due to event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] Acquiring lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] Acquired lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.network.neutron [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4b7186b-3b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ec44b3f-7472-4b58-a727-644be2e44d1c) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:31:59 user nova-compute[76391]: INFO os_vif [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b')
Nov 15 23:31:59 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Deleting instance files /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c_del
Nov 15 23:31:59 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Deletion of /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c_del complete
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.network.neutron [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updated VIF entry in instance network info cache for port e9b8989d-623b-41ab-afe4-80edc71bb67c. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.network.neutron [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea8d7cf0-9d02-4a79-8c6e-994c88832310 req-8a7683a6-bdda-4df1-ba5c-4d44afef3cb9 service nova] Releasing lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:31:59 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Deleted allocations for instance 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c
Nov 15 23:31:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.objects.instance [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'numa_topology' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:31:59 user nova-compute[76391]: DEBUG nova.objects.base [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<80a0c2c9-85a3-4895-b5d8-8544e44a4f6c> lazy-loaded attributes: resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.network.neutron [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updated VIF entry in instance network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.network.neutron [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8c175ccd-c2b3-4f1f-bcde-a2d69a2c6717 req-9aaf36b3-dae5-4b9b-a92a-1f6ad7282738 service nova] Releasing lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.702s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f74e6446-3092-44bd-a596-8d31df2f81a3 tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.694s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:01 user nova-compute[76391]: INFO nova.compute.manager [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Attaching volume a1f037e5-4825-4eb1-9100-a801decaebbe to /dev/vdb
Nov 15 23:32:01 user nova-compute[76391]: DEBUG os_brick.utils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196e4ac-b824-41e4-8f0c-8ac17c9b9233]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7303b55-969a-4822-8647-337849eab922]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43181e48-58df-4005-a782-8e436a11996f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c4ba7b-9f0b-48a4-8ce5-7cc7b0daa13b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:32:01 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:32:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ea3ae-d5c8-44ba-8bcd-69446dda53f8]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG os_brick.utils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:01 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating existing volume attachment record: 0b997008-43ca-41a2-aef6-1d8ef7a0e461 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:32:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlVbgBZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:06 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:06 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:06 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0828fc-95dd-4665-bead-8e2e35e3ac33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:32:06 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94d8c26-cb5e-45c8-b92d-222f70fbebac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe] added
Nov 15 23:32:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d91382-a38a-4b79-a98c-c82e14a606ba]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb5a51c-403e-427e-bc69-5fde344f5d8b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlVbgBZE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlVbgBZE" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2162df-d3d3-489a-9bb5-a4cc3ebcd48c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nlVbgBZE'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5154537-6092-4438-a75d-beb43ef0db6c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bd3286-ee9b-4ef9-9ec4-e0d92d7903fd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aad2e32-c503-4b5a-8cde-5378508f256e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]
Nov 15 23:32:06 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.
Nov 15 23:32:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c47bc-8cbd-481b-879c-5209bf1ab995]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de7f0a4-b6f7-4caa-ac30-e3c7c0aa3d72]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:32:06 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:06 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] HCTL ('40', '-', '-', 0) found on session 42 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1c6b4-3d06-46e2-911e-28b17c2fafb3]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching for a device in session 42 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:32:06 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlVbgBZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:32:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23463323862353032', 'path': '/dev/sdi'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463323862353032', 'path': '/dev/sdi'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:32:07 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:07 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:32:07 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:07 user nova-compute[76391]:   <source dev="/dev/sdi"/>
Nov 15 23:32:07 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:07 user nova-compute[76391]:   <serial>a1f037e5-4825-4eb1-9100-a801decaebbe</serial>
Nov 15 23:32:07 user nova-compute[76391]: </disk>
Nov 15 23:32:07 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No VIF found with MAC fa:16:3e:ec:71:f6, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9864d1a9-b77f-4f77-917c-5b86e739e5ea tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.219s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8b3c90e7-d5e4-4883-9595-20d8f9964404 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8b3c90e7-d5e4-4883-9595-20d8f9964404 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8b3c90e7-d5e4-4883-9595-20d8f9964404 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8b3c90e7-d5e4-4883-9595-20d8f9964404 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76391) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 23:32:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8b3c90e7-d5e4-4883-9595-20d8f9964404 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-d5386a4c-d667-40bb-8f9d-5599b4fb9046 req-4b81c85d-4e95-453f-b1ea-4188199f3ce5 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d5386a4c-d667-40bb-8f9d-5599b4fb9046 req-4b81c85d-4e95-453f-b1ea-4188199f3ce5 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d5386a4c-d667-40bb-8f9d-5599b4fb9046 req-4b81c85d-4e95-453f-b1ea-4188199f3ce5 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d5386a4c-d667-40bb-8f9d-5599b4fb9046 req-4b81c85d-4e95-453f-b1ea-4188199f3ce5 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-d5386a4c-d667-40bb-8f9d-5599b4fb9046 req-4b81c85d-4e95-453f-b1ea-4188199f3ce5 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:32:09 user nova-compute[76391]: WARNING nova.compute.manager [req-d5386a4c-d667-40bb-8f9d-5599b4fb9046 req-4b81c85d-4e95-453f-b1ea-4188199f3ce5 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state active and task_state powering-off.
Nov 15 23:32:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance destroyed successfully.
Nov 15 23:32:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-8b3c90e7-d5e4-4883-9595-20d8f9964404 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:32:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8b3c90e7-d5e4-4883-9595-20d8f9964404 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.857s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-76e5098e-b436-4dde-9a1c-f96f409dda60 req-1f36f3d8-19c4-447f-80dc-437fcfd1795e service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76e5098e-b436-4dde-9a1c-f96f409dda60 req-1f36f3d8-19c4-447f-80dc-437fcfd1795e service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76e5098e-b436-4dde-9a1c-f96f409dda60 req-1f36f3d8-19c4-447f-80dc-437fcfd1795e service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76e5098e-b436-4dde-9a1c-f96f409dda60 req-1f36f3d8-19c4-447f-80dc-437fcfd1795e service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-76e5098e-b436-4dde-9a1c-f96f409dda60 req-1f36f3d8-19c4-447f-80dc-437fcfd1795e service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:32:11 user nova-compute[76391]: WARNING nova.compute.manager [req-76e5098e-b436-4dde-9a1c-f96f409dda60 req-1f36f3d8-19c4-447f-80dc-437fcfd1795e service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state stopped and task_state None.
Nov 15 23:32:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:16 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63907be3-2f2f-4d5f-921d-20020c1a018b is timed out.
Nov 15 23:32:16 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Successfully detached device vdb from instance 63907be3-2f2f-4d5f-921d-20020c1a018b from the live domain config.
Nov 15 23:32:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIXwpQKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:16 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbadbd9c-6b9c-4492-a48d-0c6a14cef9e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:32:16 user nova-compute[76391]: No targets found.
Nov 15 23:32:16 user nova-compute[76391]: iSNS:
Nov 15 23:32:16 user nova-compute[76391]: No targets found.
Nov 15 23:32:16 user nova-compute[76391]: STATIC:
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20
Nov 15 23:32:16 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:16 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:16 user nova-compute[76391]: FIRMWARE:
Nov 15 23:32:16 user nova-compute[76391]: No targets found.
Nov 15 23:32:16 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:32:16 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:32:16 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f146f0d-33ac-4a31-8117-ad4ad329660a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f98d5-d1cf-468b-aece-774bb8b36c2a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:16 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd (non-flash)
Nov 15 23:32:16 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:16 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9760081090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd'): ({'sdh'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Removing single pathed devices sdh {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdca3b6a-5f50-4f20-8bec-4ed8ae735ea3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7d87cf-0035-4ed5-80cb-d659716592e3]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Flushing IO for device /dev/sdh {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae404ca-82aa-4602-beac-0ab2bbd3c3f5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93136dd-ebdd-4460-8c9c-fce017412059]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] SCSI volumes sdh have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c32dbb-7d46-4a59-94b5-7414c70c1f0b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1953f50-1386-4fc8-a7df-aee1addfd347]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260]
Nov 15 23:32:16 user nova-compute[76391]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd, portal: 172.16.0.220,3260] successful.
Nov 15 23:32:16 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509b9acb-f989-4893-8a87-1c717d5bedcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec14f4d8-5183-43a7-9c96-f5095522fc65]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] <== disconnect_volume: return (340ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:16 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:32:17 user nova-compute[76391]: DEBUG nova.objects.instance [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'flavor' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-eca5d78c-c74a-41f2-8000-20ef0dcf6473 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing instance network info cache due to event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:32:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] Acquiring lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:32:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] Acquired lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:32:18 user nova-compute[76391]: DEBUG nova.network.neutron [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updated VIF entry in instance network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9c05e6aa-0fc2-4c7c-a44a-f799953c461a req-a9484dbf-266a-4303-9887-7106b517645b service nova] Releasing lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.compute.manager [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing instance network info cache due to event network-changed-6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] Acquiring lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] Acquired lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Refreshing network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:19 user nova-compute[76391]: INFO nova.compute.manager [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Detaching volume f4a5e55a-6b32-4c04-bab0-9b030156cae4
Nov 15 23:32:19 user nova-compute[76391]: INFO nova.virt.block_device [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Attempting to driver detach volume f4a5e55a-6b32-4c04-bab0-9b030156cae4 from mountpoint /dev/vdb
Nov 15 23:32:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Attempting to detach device vdb from instance 745360bd-e3db-4960-870a-ea1889afff5a from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:32:19 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:19 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:32:19 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:19 user nova-compute[76391]:   <serial>f4a5e55a-6b32-4c04-bab0-9b030156cae4</serial>
Nov 15 23:32:19 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:32:19 user nova-compute[76391]: </disk>
Nov 15 23:32:19 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:32:19 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully detached device vdb from instance 745360bd-e3db-4960-870a-ea1889afff5a from the persistent domain config.
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 745360bd-e3db-4960-870a-ea1889afff5a from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:32:19 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:19 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:32:19 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:19 user nova-compute[76391]:   <serial>f4a5e55a-6b32-4c04-bab0-9b030156cae4</serial>
Nov 15 23:32:19 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:32:19 user nova-compute[76391]: </disk>
Nov 15 23:32:19 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updated VIF entry in instance network info cache for port 6242d910-98a4-4458-90fa-b4ad2bc9d3f3. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [{"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3e4f5234-0ac4-497c-a3bc-731e5d94411d req-c37b2cd3-572e-4182-91a5-cf56f78bd66c service nova] Releasing lock "refresh_cache-745360bd-e3db-4960-870a-ea1889afff5a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:32:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 745360bd-e3db-4960-870a-ea1889afff5a {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:32:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:21 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:32:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:32:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:32:21 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Updating instance_info_cache with network_info: [{"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-0c0d5ecf-3d9e-4715-87a4-16726b37f10c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:24 user nova-compute[76391]: INFO nova.compute.manager [None req-fd25d296-e804-45b9-858f-a56eb9f04ace tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Get console output
Nov 15 23:32:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:24 user nova-compute[76391]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-changed-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Refreshing instance network info cache due to event network-changed-4dc4f699-014c-4290-8c51-16132cfaae83. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] Acquiring lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] Acquired lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG nova.network.neutron [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Refreshing network info cache for port 4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG nova.network.neutron [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updated VIF entry in instance network info cache for port 4dc4f699-014c-4290-8c51-16132cfaae83. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG nova.network.neutron [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updating instance_info_cache with network_info: [{"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b798b84b-572d-4293-92d4-9437a09f7adf req-35285b7f-b298-4efe-9d48-6cc13ed13468 service nova] Releasing lock "refresh_cache-049edce7-c82d-49a4-9f7d-ee8f0e054c65" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:27 user nova-compute[76391]: INFO nova.compute.manager [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Terminating instance
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:32:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:32:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=6777MB free_disk=24.70677947998047GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.objects.instance [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'flavor' on Instance uuid 049edce7-c82d-49a4-9f7d-ee8f0e054c65 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Ignoring supplied device name: /dev/vdb
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3913ccaf-90f8-4196-bb56-3cee0547dee4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 745360bd-e3db-4960-870a-ea1889afff5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 63907be3-2f2f-4d5f-921d-20020c1a018b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 94e6e796-afc9-4058-840d-ae77df5ffcc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-b94b9c11-65c4-49a8-9008-09ae7ae2912d req-312cdf0c-459c-41be-9e44-ca08eb9a7ade service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b94b9c11-65c4-49a8-9008-09ae7ae2912d req-312cdf0c-459c-41be-9e44-ca08eb9a7ade service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b94b9c11-65c4-49a8-9008-09ae7ae2912d req-312cdf0c-459c-41be-9e44-ca08eb9a7ade service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b94b9c11-65c4-49a8-9008-09ae7ae2912d req-312cdf0c-459c-41be-9e44-ca08eb9a7ade service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-b94b9c11-65c4-49a8-9008-09ae7ae2912d req-312cdf0c-459c-41be-9e44-ca08eb9a7ade service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-b94b9c11-65c4-49a8-9008-09ae7ae2912d req-312cdf0c-459c-41be-9e44-ca08eb9a7ade service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-unplugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:27 user nova-compute[76391]: INFO nova.compute.manager [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Attaching volume b0ab04a9-5854-408e-bbc9-aac3965513fe to /dev/vdb
Nov 15 23:32:27 user nova-compute[76391]: DEBUG os_brick.utils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a35f4b5-bb56-4979-9843-e0bcbc95229f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c3c8ea-628b-4692-907b-8e181808898c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93438c3-1716-4055-b957-9f159984812d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d0da6a-5fc7-4fba-9b65-b77109a6969a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:32:28 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22f38e1-910f-4983-8f34-2967f1c6c624]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.utils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updating existing volume attachment record: d70d584a-1e56-4cdd-90b5-585d30d1f2f0 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Instance destroyed successfully.
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.objects.instance [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lazy-loading 'resources' on Instance uuid 94e6e796-afc9-4058-840d-ae77df5ffcc3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925434621',display_name='tempest-TestShelveInstance-server-1925434621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925434621',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPrzGj1so767S6ODaoPSCzjeB6w7evmPlNZ3mvLaVmQRdlm+PESukcUE8uqVKhJOxoNqux2Ka0uJmSGp0dRzCqOIGmBzOmr8W8xGgQEr59/bAS2KNhyW4h1Ix5TKr5Kkw==',key_name='tempest-TestShelveInstance-1887119281',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5db709fa12274eab9402a50013e7db5f',ramdisk_id='',reservation_id='r-ktv3zmaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2043367122',owner_user_name='tempest-TestShelveInstance-2043367122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:30:49Z,user_data=None,user_id='44386665eb154a26b4a15de6ae2f4ebb',uuid=94e6e796-afc9-4058-840d-ae77df5ffcc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converting VIF {"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_vif [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49be1bfc-4b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d87c7a6-f9de-4d8d-a653-4a21d03d70ea) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:28 user nova-compute[76391]: INFO os_vif [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1e:59,bridge_name='br-int',has_traffic_filtering=True,id=49be1bfc-4b91-464c-9ce8-f25d34d5775d,network=Network(509cfc62-884f-401a-810d-ded1d3d1e4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49be1bfc-4b')
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjLsQnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:28 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[272dbcb3-2eda-4a4a-bb53-2c72732ec761]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:32:28 user nova-compute[76391]: No targets found.
Nov 15 23:32:28 user nova-compute[76391]: iSNS:
Nov 15 23:32:28 user nova-compute[76391]: No targets found.
Nov 15 23:32:28 user nova-compute[76391]: STATIC:
Nov 15 23:32:28 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:32:28 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:28 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:28 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:32:28 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:28 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:28 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:32:28 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:28 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:28 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:32:28 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:28 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:28 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4
Nov 15 23:32:28 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:28 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:28 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:32:28 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:28 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:28 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20
Nov 15 23:32:28 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:28 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:28 user nova-compute[76391]: FIRMWARE:
Nov 15 23:32:28 user nova-compute[76391]: No targets found.
Nov 15 23:32:28 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:32:28 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:32:28 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4a31f4-ef96-4c51-85c5-d44677e1211c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c75a72-2fab-4a70-9215-a15c0d274527]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:28 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 (non-flash)
Nov 15 23:32:28 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:28 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405c8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d814d3-908c-4480-8cd1-42f9079f7021]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing instance network info cache due to event network-changed-49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] Acquiring lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] Acquired lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Refreshing network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cf1a37-4d61-4d0a-8c50-4de9fb716790]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9977bc21-9aae-4473-bda2-bbffac2c98d8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae11cad-92a3-41c2-96d1-68d26dedeff8]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcde197c3-722bd68432183c3f', '/dev/disk/by-id/scsi-23732326264363834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cde197c3') {{(pid=86206) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b51fa83-51b3-4b32-9ddf-3533d8a2e0db]: (4, None) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beee5de-6278-48bf-95f1-6d06dc58b847]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b95be1-9d7b-4329-8cdb-81652d3c627c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260]
Nov 15 23:32:28 user nova-compute[76391]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20, portal: 172.16.0.220,3260] successful.
Nov 15 23:32:28 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f256a166-9449-4554-b53c-1810162e9a20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae7b7a-832b-48cd-be05-97ec22156a9f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] <== disconnect_volume: return (371ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:32:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Deleting instance files /opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3_del
Nov 15 23:32:28 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Deletion of /opt/stack/data/nova/instances/94e6e796-afc9-4058-840d-ae77df5ffcc3_del complete
Nov 15 23:32:28 user nova-compute[76391]: INFO nova.compute.manager [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updated VIF entry in instance network info cache for port 49be1bfc-4b91-464c-9ce8-f25d34d5775d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [{"id": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "address": "fa:16:3e:c2:1e:59", "network": {"id": "509cfc62-884f-401a-810d-ded1d3d1e4e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1890070876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5db709fa12274eab9402a50013e7db5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49be1bfc-4b", "ovs_interfaceid": "49be1bfc-4b91-464c-9ce8-f25d34d5775d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6796caa9-e007-40ce-83d1-0cce19fd5072 req-349a0d8e-619b-470a-857a-3c1f1a426b07 service nova] Releasing lock "refresh_cache-94e6e796-afc9-4058-840d-ae77df5ffcc3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:32:29 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:29 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Took 0.48 seconds to deallocate network for instance.
Nov 15 23:32:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-7fc58f63-06e0-4c66-b920-a0d3ef0cbceb req-66e2f79e-7efb-491e-b8ea-82f7e61c82e9 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7fc58f63-06e0-4c66-b920-a0d3ef0cbceb req-66e2f79e-7efb-491e-b8ea-82f7e61c82e9 service nova] Acquiring lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7fc58f63-06e0-4c66-b920-a0d3ef0cbceb req-66e2f79e-7efb-491e-b8ea-82f7e61c82e9 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7fc58f63-06e0-4c66-b920-a0d3ef0cbceb req-66e2f79e-7efb-491e-b8ea-82f7e61c82e9 service nova] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-7fc58f63-06e0-4c66-b920-a0d3ef0cbceb req-66e2f79e-7efb-491e-b8ea-82f7e61c82e9 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] No waiting events found dispatching network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:32:29 user nova-compute[76391]: WARNING nova.compute.manager [req-7fc58f63-06e0-4c66-b920-a0d3ef0cbceb req-66e2f79e-7efb-491e-b8ea-82f7e61c82e9 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received unexpected event network-vif-plugged-49be1bfc-4b91-464c-9ce8-f25d34d5775d for instance with vm_state active and task_state deleting.
Nov 15 23:32:29 user nova-compute[76391]: DEBUG nova.compute.manager [req-7fc58f63-06e0-4c66-b920-a0d3ef0cbceb req-66e2f79e-7efb-491e-b8ea-82f7e61c82e9 service nova] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Received event network-vif-deleted-49be1bfc-4b91-464c-9ce8-f25d34d5775d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:30 user nova-compute[76391]: INFO nova.compute.manager [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 23:32:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] [instance: 94e6e796-afc9-4058-840d-ae77df5ffcc3] Deleting volume: f256a166-9449-4554-b53c-1810162e9a20 {{(pid=76391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:30 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Deleted allocations for instance 94e6e796-afc9-4058-840d-ae77df5ffcc3
Nov 15 23:32:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-df4ca8c4-69e9-458b-8fd5-12c28be4e4f4 tempest-TestShelveInstance-2043367122 tempest-TestShelveInstance-2043367122-project-member] Lock "94e6e796-afc9-4058-840d-ae77df5ffcc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.352s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:32:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhBnabIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:33 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:33 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:33 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23f250d-4197-42bd-9d01-8453dd856028]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:32:33 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de578715-fe37-4dcc-801b-c05b3a79a338]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe] added
Nov 15 23:32:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18104acc-39cb-4ec9-97b2-5cfb28589c11]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2bcfc7-ef09-4f02-8096-8939f0d3e492]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhBnabIw {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhBnabIw" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a99039-0744-4f22-b9da-68f48f235a8d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mhBnabIw'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16da702e-039f-4711-b275-6f530f7d3027]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6791cd7c-0711-476e-969e-fcdd3d9bdd9f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0504781f-e63d-4df0-b9d9-5bcefe270038]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260]
Nov 15 23:32:33 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260] successful.
Nov 15 23:32:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f1fdc-2867-4fea-80a5-40c34ef5d2c9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[746c0ec7-6e45-4c27-9979-ebd04d68fd68]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:33 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:33 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d736e6fd-aa2f-4e4c-9085-2b86cf356d46]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:33 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhBnabIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23262393339353839', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262393339353839', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG nova.objects.instance [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'flavor' on Instance uuid 049edce7-c82d-49a4-9f7d-ee8f0e054c65 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:32:34 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:34 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:32:34 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:34 user nova-compute[76391]:   <serial>b0ab04a9-5854-408e-bbc9-aac3965513fe</serial>
Nov 15 23:32:34 user nova-compute[76391]: </disk>
Nov 15 23:32:34 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:32:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No VIF found with MAC fa:16:3e:65:f9:02, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:32:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-4fa3585d-6d78-4b8c-b302-c83e95be33c8 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.233s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:40 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 745360bd-e3db-4960-870a-ea1889afff5a is timed out.
Nov 15 23:32:40 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully detached device vdb from instance 745360bd-e3db-4960-870a-ea1889afff5a from the live domain config.
Nov 15 23:32:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVEhHOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:40 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2a145b-86ca-4ab5-98e0-a306e7386b52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:32:40 user nova-compute[76391]: No targets found.
Nov 15 23:32:40 user nova-compute[76391]: iSNS:
Nov 15 23:32:40 user nova-compute[76391]: No targets found.
Nov 15 23:32:40 user nova-compute[76391]: STATIC:
Nov 15 23:32:40 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:32:40 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:40 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:40 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:32:40 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:40 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:40 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:32:40 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:40 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:40 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:32:40 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:40 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:40 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4
Nov 15 23:32:40 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:40 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:40 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:32:40 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:40 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:40 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe
Nov 15 23:32:40 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:32:40 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:32:40 user nova-compute[76391]: FIRMWARE:
Nov 15 23:32:40 user nova-compute[76391]: No targets found.
Nov 15 23:32:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:32:40 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:32:40 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2938bf97-89b0-4648-a09f-4a632eb13e22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbef875-201f-4926-91ba-0d8500856c49]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:40 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f974037e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4'): ({'sde'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Removing single pathed devices sde {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[339ebe3d-11ba-4a8d-ae4d-8f00255cd2db]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ab2a2-e82f-46d6-90c0-0ae53c669566]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Flushing IO for device /dev/sde {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485e464-1641-46bc-9f9b-d0e6d446a376]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6014196a-5a27-40b9-8412-fdcc7b9acfed]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f989d357-cdab-40f8-bbab-a01e312ee694]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[243ccbfb-6914-4b74-ae6d-d8c783ff3482]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260]
Nov 15 23:32:40 user nova-compute[76391]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4, portal: 172.16.0.220,3260] successful.
Nov 15 23:32:40 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a5e55a-6b32-4c04-bab0-9b030156cae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f7ba58-79ad-4754-b35e-2446ec5d18c1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] <== disconnect_volume: return (342ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:40 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:32:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'flavor' on Instance uuid 745360bd-e3db-4960-870a-ea1889afff5a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d5779205-bdfc-4bbf-98e1-c772d380a1f1 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:46 user nova-compute[76391]: INFO nova.compute.manager [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Terminating instance
Nov 15 23:32:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-c8ce37db-3228-42c6-b2fb-a60a013a4776 req-e57b7fac-d61c-4522-af6d-4b855bb36907 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-vif-unplugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c8ce37db-3228-42c6-b2fb-a60a013a4776 req-e57b7fac-d61c-4522-af6d-4b855bb36907 service nova] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c8ce37db-3228-42c6-b2fb-a60a013a4776 req-e57b7fac-d61c-4522-af6d-4b855bb36907 service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c8ce37db-3228-42c6-b2fb-a60a013a4776 req-e57b7fac-d61c-4522-af6d-4b855bb36907 service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-c8ce37db-3228-42c6-b2fb-a60a013a4776 req-e57b7fac-d61c-4522-af6d-4b855bb36907 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] No waiting events found dispatching network-vif-unplugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:32:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-c8ce37db-3228-42c6-b2fb-a60a013a4776 req-e57b7fac-d61c-4522-af6d-4b855bb36907 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-vif-unplugged-6969b61a-3736-4393-935f-aa33cf7d4b1f for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:32:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Instance destroyed successfully.
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lazy-loading 'resources' on Instance uuid 63907be3-2f2f-4d5f-921d-20020c1a018b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-815542623',display_name='tempest-TestServerVolumeAttachmentScenario-server-815542623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-815542623',id=37,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw2eZGycZBoYWWAHaZ8hllmO/gH2iD+y8qlbfuWNXRrQuXDjWaXgHRHicZMhhsGy72Kf2R3zI+R9eIEIFekyy40C/Xnq1no13UHR2d96PJ5yLXBdE6KWAqPR93W2PkwNg==',key_name='tempest-keypair-1597731779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='913d851a2447440ca19ff9134580033c',ramdisk_id='',reservation_id='r-pix34opv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2119127060',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2119127060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a528d0d051842a5882c42869a100837',uuid=63907be3-2f2f-4d5f-921d-20020c1a018b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Converting VIF {"id": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "address": "fa:16:3e:10:70:3c", "network": {"id": "70f33554-9ad8-4e43-ae8f-8698588862df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1754719130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "913d851a2447440ca19ff9134580033c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6969b61a-37", "ovs_interfaceid": "6969b61a-3736-4393-935f-aa33cf7d4b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:70:3c,bridge_name='br-int',has_traffic_filtering=True,id=6969b61a-3736-4393-935f-aa33cf7d4b1f,network=Network(70f33554-9ad8-4e43-ae8f-8698588862df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6969b61a-37') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG os_vif [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:70:3c,bridge_name='br-int',has_traffic_filtering=True,id=6969b61a-3736-4393-935f-aa33cf7d4b1f,network=Network(70f33554-9ad8-4e43-ae8f-8698588862df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6969b61a-37') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6969b61a-37, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4d019df-5803-451a-9461-8f58abe9e256) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:47 user nova-compute[76391]: INFO os_vif [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:70:3c,bridge_name='br-int',has_traffic_filtering=True,id=6969b61a-3736-4393-935f-aa33cf7d4b1f,network=Network(70f33554-9ad8-4e43-ae8f-8698588862df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6969b61a-37')
Nov 15 23:32:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Deleting instance files /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b_del
Nov 15 23:32:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Deletion of /opt/stack/data/nova/instances/63907be3-2f2f-4d5f-921d-20020c1a018b_del complete
Nov 15 23:32:47 user nova-compute[76391]: INFO nova.compute.manager [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 23:32:47 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-changed-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Refreshing instance network info cache due to event network-changed-d876d1a1-206d-4400-a2c5-1e2cbfa0589d. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] Acquiring lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] Acquired lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:32:47 user nova-compute[76391]: DEBUG nova.network.neutron [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Refreshing network info cache for port d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updated VIF entry in instance network info cache for port d876d1a1-206d-4400-a2c5-1e2cbfa0589d. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updating instance_info_cache with network_info: [{"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6943aaa4-ba17-4556-8909-51a6e98123c4 req-1fed0506-9043-4218-a4ef-6752f5720ce6 service nova] Releasing lock "refresh_cache-3489fe22-21c6-4d85-9dca-8bb8d89212dc" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:48 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Took 1.26 seconds to deallocate network for instance.
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-5675157f-d469-47de-ab2d-f47f522e1b36 req-a4a3c410-f84c-41a4-b929-ffb73cf33822 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-vif-deleted-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:48 user nova-compute[76391]: INFO nova.compute.manager [req-5675157f-d469-47de-ab2d-f47f522e1b36 req-a4a3c410-f84c-41a4-b929-ffb73cf33822 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Neutron deleted interface 6969b61a-3736-4393-935f-aa33cf7d4b1f; detaching it from the instance and deleting it from the info cache
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-5675157f-d469-47de-ab2d-f47f522e1b36 req-a4a3c410-f84c-41a4-b929-ffb73cf33822 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-5675157f-d469-47de-ab2d-f47f522e1b36 req-a4a3c410-f84c-41a4-b929-ffb73cf33822 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Detach interface failed, port_id=6969b61a-3736-4393-935f-aa33cf7d4b1f, reason: Instance 63907be3-2f2f-4d5f-921d-20020c1a018b could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0071365-3d2b-4df5-a4cd-2830db967ade req-234fbea2-e9cf-4d66-bd98-40b276ffce94 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received event network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0071365-3d2b-4df5-a4cd-2830db967ade req-234fbea2-e9cf-4d66-bd98-40b276ffce94 service nova] Acquiring lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0071365-3d2b-4df5-a4cd-2830db967ade req-234fbea2-e9cf-4d66-bd98-40b276ffce94 service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0071365-3d2b-4df5-a4cd-2830db967ade req-234fbea2-e9cf-4d66-bd98-40b276ffce94 service nova] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0071365-3d2b-4df5-a4cd-2830db967ade req-234fbea2-e9cf-4d66-bd98-40b276ffce94 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] No waiting events found dispatching network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:32:48 user nova-compute[76391]: WARNING nova.compute.manager [req-e0071365-3d2b-4df5-a4cd-2830db967ade req-234fbea2-e9cf-4d66-bd98-40b276ffce94 service nova] [instance: 63907be3-2f2f-4d5f-921d-20020c1a018b] Received unexpected event network-vif-plugged-6969b61a-3736-4393-935f-aa33cf7d4b1f for instance with vm_state deleted and task_state None.
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:48 user nova-compute[76391]: INFO nova.compute.manager [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Detaching volume b0ab04a9-5854-408e-bbc9-aac3965513fe
Nov 15 23:32:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:49 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Deleted allocations for instance 63907be3-2f2f-4d5f-921d-20020c1a018b
Nov 15 23:32:49 user nova-compute[76391]: INFO nova.virt.block_device [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Attempting to driver detach volume b0ab04a9-5854-408e-bbc9-aac3965513fe from mountpoint /dev/vdb
Nov 15 23:32:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Attempting to detach device vdb from instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:32:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:49 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:32:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:49 user nova-compute[76391]:   <serial>b0ab04a9-5854-408e-bbc9-aac3965513fe</serial>
Nov 15 23:32:49 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:32:49 user nova-compute[76391]: </disk>
Nov 15 23:32:49 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:32:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully detached device vdb from instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 from the persistent domain config.
Nov 15 23:32:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:32:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:49 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:32:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:49 user nova-compute[76391]:   <serial>b0ab04a9-5854-408e-bbc9-aac3965513fe</serial>
Nov 15 23:32:49 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:32:49 user nova-compute[76391]: </disk>
Nov 15 23:32:49 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c881c6f5-bbb1-492e-aeba-4056d07325a9 tempest-TestServerVolumeAttachmentScenario-2119127060 tempest-TestServerVolumeAttachmentScenario-2119127060-project-member] Lock "63907be3-2f2f-4d5f-921d-20020c1a018b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid 3489fe22-21c6-4d85-9dca-8bb8d89212dc {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:49 user nova-compute[76391]: INFO nova.compute.manager [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Attaching volume fbe2600c-1829-4b5e-8b35-e7d1b64419e5 to /dev/vdb
Nov 15 23:32:49 user nova-compute[76391]: DEBUG os_brick.utils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a240a3-744d-4ff1-bc39-474c94368ec8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca6106-ef05-40df-8950-8c3605c895f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e2b9b-fdca-4638-b68c-5aea615e22fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa76a656-b78b-4998-b07b-ff180b4401b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:32:49 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:32:49 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce09cbb-293e-4f5b-9118-ad7b04844ec8]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG os_brick.utils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:49 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updating existing volume attachment record: 92896972-d322-46b5-b51d-d678ae8a4a12 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:32:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjlJZSRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:32:54 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:54 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:32:54 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea69a9-65bd-43e2-964e-6de8fe3be448]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:32:54 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a061a281-1819-496f-900d-1af6f58da030]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5] added
Nov 15 23:32:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[098d73e3-0d46-4864-b455-2d7bd0cdbb4f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35525051-684f-41fe-a070-d22f5417f30a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjlJZSRn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjlJZSRn" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26823921-5734-4f1d-bed1-1985e0c21c93]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OjlJZSRn'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c78359-d99b-449f-8fcd-db5ad9fe1c24]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027e33e-e6f9-4e25-955e-b9b4af87d75d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e227a34b-3248-4dd4-b80e-9a5a66f87037]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260]
Nov 15 23:32:54 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260] successful.
Nov 15 23:32:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6acb538-9418-446c-92b4-26258e5dec89]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[016e8e62-8f35-4d70-9ac5-0751350fd7e8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:32:54 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:32:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a5ccf1-7916-4839-ac4d-39494c895b50]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:32:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjlJZSRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:32:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:32:55 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23833386538366638', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:32:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833386538366638', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:32:55 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid 3489fe22-21c6-4d85-9dca-8bb8d89212dc {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:32:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:32:55 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:55 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:32:55 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:55 user nova-compute[76391]:   <serial>fbe2600c-1829-4b5e-8b35-e7d1b64419e5</serial>
Nov 15 23:32:55 user nova-compute[76391]: </disk>
Nov 15 23:32:55 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:32:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:32:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:32:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] No VIF found with MAC fa:16:3e:92:fc:f0, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:32:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7fe8cf3-359d-436d-97ab-e5d8ace378e8 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.928s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:32:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:32:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:32:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:32:57 user nova-compute[76391]: INFO nova.compute.manager [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Detaching volume fbe2600c-1829-4b5e-8b35-e7d1b64419e5
Nov 15 23:32:57 user nova-compute[76391]: INFO nova.virt.block_device [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Attempting to driver detach volume fbe2600c-1829-4b5e-8b35-e7d1b64419e5 from mountpoint /dev/vdb
Nov 15 23:32:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Attempting to detach device vdb from instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:32:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:32:57 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:57 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:32:57 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:57 user nova-compute[76391]:   <serial>fbe2600c-1829-4b5e-8b35-e7d1b64419e5</serial>
Nov 15 23:32:57 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:32:57 user nova-compute[76391]: </disk>
Nov 15 23:32:57 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:32:57 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully detached device vdb from instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc from the persistent domain config.
Nov 15 23:32:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:32:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:32:57 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:32:57 user nova-compute[76391]:   <source dev="/dev/sde"/>
Nov 15 23:32:57 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:32:57 user nova-compute[76391]:   <serial>fbe2600c-1829-4b5e-8b35-e7d1b64419e5</serial>
Nov 15 23:32:57 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:32:57 user nova-compute[76391]: </disk>
Nov 15 23:32:57 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:32:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:33:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:09 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 is timed out.
Nov 15 23:33:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully detached device vdb from instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 from the live domain config.
Nov 15 23:33:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhBnabIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:33:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f46c0de-ea44-461e-8bde-73aa43427d4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:33:09 user nova-compute[76391]: No targets found.
Nov 15 23:33:09 user nova-compute[76391]: iSNS:
Nov 15 23:33:09 user nova-compute[76391]: No targets found.
Nov 15 23:33:09 user nova-compute[76391]: STATIC:
Nov 15 23:33:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:33:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5
Nov 15 23:33:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:33:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:33:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:33:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:33:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe
Nov 15 23:33:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:09 user nova-compute[76391]: FIRMWARE:
Nov 15 23:33:09 user nova-compute[76391]: No targets found.
Nov 15 23:33:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:33:09 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:33:09 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed785e4a-adbf-438c-bf80-542c9cc002a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1567fa98-3d63-4072-8408-bb0c9ca90bab]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe (non-flash)
Nov 15 23:33:09 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740359360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[002358ca-1be2-43ae-8feb-c01205cc9448]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f6fc93-b4da-4be2-8c5e-59f3bb3eb70a]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70425e73-58cc-4df6-9c44-c0c676ad7bee]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c37d94-ed02-49be-8b25-ff7712230e4d]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad87f2-9c5b-459a-9e64-38e350603fc6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec0bd6-8acd-45a0-bffd-f5b79f6a592d]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260]
Nov 15 23:33:09 user nova-compute[76391]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe, portal: 172.16.0.220,3260] successful.
Nov 15 23:33:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1117883-323d-4a6e-9514-9ef5dbe26a2f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== disconnect_volume: return (327ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:33:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG nova.objects.instance [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'flavor' on Instance uuid 049edce7-c82d-49a4-9f7d-ee8f0e054c65 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-7706db30-d65b-4ba1-8934-2ce1b93c1dca tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.591s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:10 user nova-compute[76391]: INFO nova.compute.manager [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Terminating instance
Nov 15 23:33:10 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-fb364817-7a2d-4ec3-8d6f-11302f84c756 req-326913c7-fe62-466f-8d42-cfbcafddc2ba service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-vif-unplugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fb364817-7a2d-4ec3-8d6f-11302f84c756 req-326913c7-fe62-466f-8d42-cfbcafddc2ba service nova] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fb364817-7a2d-4ec3-8d6f-11302f84c756 req-326913c7-fe62-466f-8d42-cfbcafddc2ba service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fb364817-7a2d-4ec3-8d6f-11302f84c756 req-326913c7-fe62-466f-8d42-cfbcafddc2ba service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-fb364817-7a2d-4ec3-8d6f-11302f84c756 req-326913c7-fe62-466f-8d42-cfbcafddc2ba service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] No waiting events found dispatching network-vif-unplugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-fb364817-7a2d-4ec3-8d6f-11302f84c756 req-326913c7-fe62-466f-8d42-cfbcafddc2ba service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-vif-unplugged-4dc4f699-014c-4290-8c51-16132cfaae83 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Instance destroyed successfully.
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'resources' on Instance uuid 049edce7-c82d-49a4-9f7d-ee8f0e054c65 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1092623807',display_name='tempest-VolumesSnapshotTestJSON-instance-1092623807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1092623807',id=40,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrQ1nd7VxSeCc7mwrS6ComELLnmWTlKdDEXWdkqolX+bfScHUc/BVXrRbMELL6udZIhQ+OhV4Qu2/9AZ/VvUEmGi0BEOWib1bBhiKWv5ytHGHc1VkONR0maMcuzom9stw==',key_name='tempest-keypair-442881919',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82e478c752c644aebfcbc4db437dfc5e',ramdisk_id='',reservation_id='r-pk4mmd9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2045009250',owner_user_name='tempest-VolumesSnapshotTestJSON-2045009250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7822512a5a344405ad7ec0fe7f3aba35',uuid=049edce7-c82d-49a4-9f7d-ee8f0e054c65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converting VIF {"id": "4dc4f699-014c-4290-8c51-16132cfaae83", "address": "fa:16:3e:65:f9:02", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc4f699-01", "ovs_interfaceid": "4dc4f699-014c-4290-8c51-16132cfaae83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=4dc4f699-014c-4290-8c51-16132cfaae83,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc4f699-01') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_vif [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=4dc4f699-014c-4290-8c51-16132cfaae83,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc4f699-01') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dc4f699-01, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdc17a85-f9c6-4846-93ad-03cfc25d36fa) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:11 user nova-compute[76391]: INFO os_vif [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f9:02,bridge_name='br-int',has_traffic_filtering=True,id=4dc4f699-014c-4290-8c51-16132cfaae83,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc4f699-01')
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhBnabIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:33:11 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79dd801-7fa8-452c-b55c-33b3b563a184]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:33:11 user nova-compute[76391]: No targets found.
Nov 15 23:33:11 user nova-compute[76391]: iSNS:
Nov 15 23:33:11 user nova-compute[76391]: No targets found.
Nov 15 23:33:11 user nova-compute[76391]: STATIC:
Nov 15 23:33:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:33:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5
Nov 15 23:33:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:33:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:33:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:33:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:33:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:11 user nova-compute[76391]: FIRMWARE:
Nov 15 23:33:11 user nova-compute[76391]: No targets found.
Nov 15 23:33:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:33:11 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:33:11 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ab04a9-5854-408e-bbc9-aac3965513fe', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa25a5-7c51-44a4-9bf1-54c94bb588e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa612a-d374-47cb-b7d1-1e10271aa742]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:11 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97606671c0>, {}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Disconnecting from: [] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== disconnect_volume: return (83ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:33:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Deleting instance files /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65_del
Nov 15 23:33:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Deletion of /opt/stack/data/nova/instances/049edce7-c82d-49a4-9f7d-ee8f0e054c65_del complete
Nov 15 23:33:11 user nova-compute[76391]: INFO nova.compute.manager [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 23:33:11 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:33:11 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:12 user nova-compute[76391]: INFO nova.compute.manager [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Terminating instance
Nov 15 23:33:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-64f427cf-0c63-4bb3-908f-9409b562b155 req-a1fb3010-04a9-43ba-9856-2d50a547333f service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-vif-deleted-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:12 user nova-compute[76391]: INFO nova.compute.manager [req-64f427cf-0c63-4bb3-908f-9409b562b155 req-a1fb3010-04a9-43ba-9856-2d50a547333f service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Neutron deleted interface 4dc4f699-014c-4290-8c51-16132cfaae83; detaching it from the instance and deleting it from the info cache
Nov 15 23:33:12 user nova-compute[76391]: DEBUG nova.network.neutron [req-64f427cf-0c63-4bb3-908f-9409b562b155 req-a1fb3010-04a9-43ba-9856-2d50a547333f service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:12 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Took 0.86 seconds to deallocate network for instance.
Nov 15 23:33:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-64f427cf-0c63-4bb3-908f-9409b562b155 req-a1fb3010-04a9-43ba-9856-2d50a547333f service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Detach interface failed, port_id=4dc4f699-014c-4290-8c51-16132cfaae83, reason: Instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:33:12 user nova-compute[76391]: WARNING nova.volume.cinder [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Attachment d70d584a-1e56-4cdd-90b5-585d30d1f2f0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d70d584a-1e56-4cdd-90b5-585d30d1f2f0. (HTTP 404) (Request-ID: req-a35fe1d6-bb44-40e3-a70e-1a9787712869)
Nov 15 23:33:12 user nova-compute[76391]: INFO nova.compute.manager [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 23:33:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Instance destroyed successfully.
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lazy-loading 'resources' on Instance uuid 745360bd-e3db-4960-870a-ea1889afff5a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1384069568',display_name='tempest-TestMinimumBasicScenario-server-1384069568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1384069568',id=36,image_ref='475afe99-564c-47e9-a7f3-1316f0fbdc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1NJSHD042FhzQbQPREnPE2/S6iDbzKlj7Z78M6S+vpwCWtPfnO+/nlK/lh/apXWW4MLqWbCq4xUV8ThzpZUbxRxSqoOJh34r3WCTJyB3wsND3oHv1BniuTvkWC5zT/Pw==',key_name='tempest-TestMinimumBasicScenario-661759224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:28:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c852b0603a2849ae851780a32addfa7d',ramdisk_id='',reservation_id='r-uftdiewc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='475afe99-564c-47e9-a7f3-1316f0fbdc78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1692035413',owner_user_name='tempest-TestMinimumBasicScenario-1692035413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:30:35Z,user_data=None,user_id='3c229306bc594655839772e64b7f0200',uuid=745360bd-e3db-4960-870a-ea1889afff5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converting VIF {"id": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "address": "fa:16:3e:f6:0a:91", "network": {"id": "c070ac17-094d-4616-bd8f-644debe73b1c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-940162362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c852b0603a2849ae851780a32addfa7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6242d910-98", "ovs_interfaceid": "6242d910-98a4-4458-90fa-b4ad2bc9d3f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=6242d910-98a4-4458-90fa-b4ad2bc9d3f3,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6242d910-98') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG os_vif [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=6242d910-98a4-4458-90fa-b4ad2bc9d3f3,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6242d910-98') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6242d910-98, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-efd4b79e-86b5-4e0d-872b-8f56ede578bd req-96a20c38-78a7-4900-a7b9-9204207e6ff2 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received event network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-efd4b79e-86b5-4e0d-872b-8f56ede578bd req-96a20c38-78a7-4900-a7b9-9204207e6ff2 service nova] Acquiring lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-efd4b79e-86b5-4e0d-872b-8f56ede578bd req-96a20c38-78a7-4900-a7b9-9204207e6ff2 service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-efd4b79e-86b5-4e0d-872b-8f56ede578bd req-96a20c38-78a7-4900-a7b9-9204207e6ff2 service nova] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-efd4b79e-86b5-4e0d-872b-8f56ede578bd req-96a20c38-78a7-4900-a7b9-9204207e6ff2 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] No waiting events found dispatching network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:13 user nova-compute[76391]: WARNING nova.compute.manager [req-efd4b79e-86b5-4e0d-872b-8f56ede578bd req-96a20c38-78a7-4900-a7b9-9204207e6ff2 service nova] [instance: 049edce7-c82d-49a4-9f7d-ee8f0e054c65] Received unexpected event network-vif-plugged-4dc4f699-014c-4290-8c51-16132cfaae83 for instance with vm_state deleted and task_state None.
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d149970-ad66-48f0-9119-be61da376a8e) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:13 user nova-compute[76391]: INFO os_vif [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=6242d910-98a4-4458-90fa-b4ad2bc9d3f3,network=Network(c070ac17-094d-4616-bd8f-644debe73b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6242d910-98')
Nov 15 23:33:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Deleting instance files /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a_del
Nov 15 23:33:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Deletion of /opt/stack/data/nova/instances/745360bd-e3db-4960-870a-ea1889afff5a_del complete
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:13 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Deleted allocations for instance 049edce7-c82d-49a4-9f7d-ee8f0e054c65
Nov 15 23:33:13 user nova-compute[76391]: INFO nova.compute.manager [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c79ae047-ec20-42fc-8d5a-4b3a9848802e tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "049edce7-c82d-49a4-9f7d-ee8f0e054c65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.565s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:13 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Took 0.45 seconds to deallocate network for instance.
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:13 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:14 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Deleted allocations for instance 745360bd-e3db-4960-870a-ea1889afff5a
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21c9542a-dcad-4660-a4d7-b9b938d7c739 tempest-TestMinimumBasicScenario-1692035413 tempest-TestMinimumBasicScenario-1692035413-project-member] Lock "745360bd-e3db-4960-870a-ea1889afff5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-unplugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-unplugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:14 user nova-compute[76391]: WARNING nova.compute.manager [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-unplugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state deleted and task_state None.
Nov 15 23:33:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] Acquiring lock "745360bd-e3db-4960-870a-ea1889afff5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] Lock "745360bd-e3db-4960-870a-ea1889afff5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] No waiting events found dispatching network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:14 user nova-compute[76391]: WARNING nova.compute.manager [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received unexpected event network-vif-plugged-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 for instance with vm_state deleted and task_state None.
Nov 15 23:33:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-38f6ad58-d102-404f-a3e0-efe5fc18db9e req-1ef6c2a1-d16b-4ea6-86b8-2a64f63cc9f3 service nova] [instance: 745360bd-e3db-4960-870a-ea1889afff5a] Received event network-vif-deleted-6242d910-98a4-4458-90fa-b4ad2bc9d3f3 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:16 user nova-compute[76391]: INFO nova.compute.manager [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Terminating instance
Nov 15 23:33:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-6e0fcefd-9a66-476b-a6ef-f0ece71c0556 req-f643106e-9ca0-4a62-bb9c-e2d0ebc7e01b service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6e0fcefd-9a66-476b-a6ef-f0ece71c0556 req-f643106e-9ca0-4a62-bb9c-e2d0ebc7e01b service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6e0fcefd-9a66-476b-a6ef-f0ece71c0556 req-f643106e-9ca0-4a62-bb9c-e2d0ebc7e01b service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6e0fcefd-9a66-476b-a6ef-f0ece71c0556 req-f643106e-9ca0-4a62-bb9c-e2d0ebc7e01b service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-6e0fcefd-9a66-476b-a6ef-f0ece71c0556 req-f643106e-9ca0-4a62-bb9c-e2d0ebc7e01b service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-6e0fcefd-9a66-476b-a6ef-f0ece71c0556 req-f643106e-9ca0-4a62-bb9c-e2d0ebc7e01b service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-unplugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:33:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:17 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Instance destroyed successfully.
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'resources' on Instance uuid 3913ccaf-90f8-4196-bb56-3cee0547dee4 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-425566497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-425566497',id=34,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-uqewve0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:31:31Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=3913ccaf-90f8-4196-bb56-3cee0547dee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "20867220-4b30-4291-96cc-6ff070d82773", "address": "fa:16:3e:20:83:e4", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20867220-4b", "ovs_interfaceid": "20867220-4b30-4291-96cc-6ff070d82773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_vif [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20867220-4b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eac060b6-a7ad-4cd5-b878-56f00fa5b44f) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:17 user nova-compute[76391]: INFO os_vif [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:83:e4,bridge_name='br-int',has_traffic_filtering=True,id=20867220-4b30-4291-96cc-6ff070d82773,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20867220-4b')
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhQxwqng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:33:17 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9dfb43-a0ae-4940-a9ff-8a9559364599]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:33:17 user nova-compute[76391]: No targets found.
Nov 15 23:33:17 user nova-compute[76391]: iSNS:
Nov 15 23:33:17 user nova-compute[76391]: No targets found.
Nov 15 23:33:17 user nova-compute[76391]: STATIC:
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: FIRMWARE:
Nov 15 23:33:17 user nova-compute[76391]: No targets found.
Nov 15 23:33:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:33:17 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:33:17 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0defd34c-5ce6-4d51-a3f7-f3d10b739a84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c1c74-c6e9-43d3-9178-daea9eecd308]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f974037fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f'): ({'sdg'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Removing single pathed devices sdg {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ae21e-db0d-4a80-bd01-e5fbcb999140]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9cf89-2853-4423-ae82-f48b0fd1212b]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flushing IO for device /dev/sdg {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed22e62-907e-4b5d-8192-02ab234ce6e4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1e6f9-32da-4474-b3a3-c0a991abda4c]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] SCSI volumes sdg have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a6b1e8-ba06-4fb0-9565-7e79a1513c29]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc is timed out.
Nov 15 23:33:17 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully detached device vdb from instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc from the live domain config.
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjlJZSRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:33:17 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7002ec4-679b-45a0-af26-bc4704c32ca7]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260]
Nov 15 23:33:17 user nova-compute[76391]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f, portal: 172.16.0.220,3260] successful.
Nov 15 23:33:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9306311e-e3bb-4a7f-924b-d73a479fc82f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaefce2-2f3b-4f62-bc44-9122fb78fb38]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== disconnect_volume: return (349ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:33:17 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Deleting instance files /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4_del
Nov 15 23:33:17 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Deletion of /opt/stack/data/nova/instances/3913ccaf-90f8-4196-bb56-3cee0547dee4_del complete
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.082s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c68ee85-0ba4-4d88-9bff-3ae37db78e68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:33:17 user nova-compute[76391]: No targets found.
Nov 15 23:33:17 user nova-compute[76391]: iSNS:
Nov 15 23:33:17 user nova-compute[76391]: No targets found.
Nov 15 23:33:17 user nova-compute[76391]: STATIC:
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:33:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:17 user nova-compute[76391]: FIRMWARE:
Nov 15 23:33:17 user nova-compute[76391]: No targets found.
Nov 15 23:33:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:33:17 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:33:17 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc29716-6dcc-4565-ab18-6c7b3411c542]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: INFO nova.compute.manager [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4916d476-4905-47af-a432-27c1c2cef645]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:17 user nova-compute[76391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 (non-flash)
Nov 15 23:33:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9760082830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5'): ({'sde'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Removing single pathed devices sde {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9101a2cb-6b86-4fd5-9136-443202d7fd07]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bccf1e-3c7f-49bf-ba22-24cb50f34f9a]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Flushing IO for device /dev/sde {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83848ef-5982-4981-ab4b-08ef82812765]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:33:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdeeb4e-9da8-4fae-82bf-a15ee5dd6bbd]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe25941-78d2-41f5-8ee1-2e0484aac816]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c296d3a1-240c-4b32-801f-3d461e797c35]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260]
Nov 15 23:33:18 user nova-compute[76391]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5, portal: 172.16.0.220,3260] successful.
Nov 15 23:33:18 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe2600c-1829-4b5e-8b35-e7d1b64419e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ee7aa-cba8-4ab1-93c4-0c62871853e8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] <== disconnect_volume: return (388ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:18 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Took 0.45 seconds to deallocate network for instance.
Nov 15 23:33:18 user nova-compute[76391]: DEBUG nova.objects.instance [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'flavor' on Instance uuid 3489fe22-21c6-4d85-9dca-8bb8d89212dc {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-2554a000-dc84-45eb-8136-aac360bdddad req-0b567ca9-cb09-4705-982c-6e899c7992b1 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2554a000-dc84-45eb-8136-aac360bdddad req-0b567ca9-cb09-4705-982c-6e899c7992b1 service nova] Acquiring lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2554a000-dc84-45eb-8136-aac360bdddad req-0b567ca9-cb09-4705-982c-6e899c7992b1 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-2554a000-dc84-45eb-8136-aac360bdddad req-0b567ca9-cb09-4705-982c-6e899c7992b1 service nova] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-2554a000-dc84-45eb-8136-aac360bdddad req-0b567ca9-cb09-4705-982c-6e899c7992b1 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] No waiting events found dispatching network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:18 user nova-compute[76391]: WARNING nova.compute.manager [req-2554a000-dc84-45eb-8136-aac360bdddad req-0b567ca9-cb09-4705-982c-6e899c7992b1 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received unexpected event network-vif-plugged-20867220-4b30-4291-96cc-6ff070d82773 for instance with vm_state active and task_state deleting.
Nov 15 23:33:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-2554a000-dc84-45eb-8136-aac360bdddad req-0b567ca9-cb09-4705-982c-6e899c7992b1 service nova] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Received event network-vif-deleted-20867220-4b30-4291-96cc-6ff070d82773 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-02c6ea7d-148b-436f-aff1-5579212551f6 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:19 user nova-compute[76391]: INFO nova.compute.manager [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 3913ccaf-90f8-4196-bb56-3cee0547dee4] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 23:33:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:19 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:33:19 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:33:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:19 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Deleted allocations for instance 3913ccaf-90f8-4196-bb56-3cee0547dee4
Nov 15 23:33:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ce2cd20d-82ea-4e2f-a5c2-11a98377f7f5 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "3913ccaf-90f8-4196-bb56-3cee0547dee4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.046s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:22 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:33:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:33:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:33:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [{"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-e640c20f-d2d0-4b48-b13c-8ee8b1af864b" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:25 user nova-compute[76391]: INFO nova.compute.manager [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Terminating instance
Nov 15 23:33:25 user nova-compute[76391]: DEBUG nova.compute.manager [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-373535d5-ebb5-48c1-b4dc-63440ba08a39 req-dc363228-33cf-4fa2-98ed-94b94236d33b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-unplugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-373535d5-ebb5-48c1-b4dc-63440ba08a39 req-dc363228-33cf-4fa2-98ed-94b94236d33b service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-373535d5-ebb5-48c1-b4dc-63440ba08a39 req-dc363228-33cf-4fa2-98ed-94b94236d33b service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-373535d5-ebb5-48c1-b4dc-63440ba08a39 req-dc363228-33cf-4fa2-98ed-94b94236d33b service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-373535d5-ebb5-48c1-b4dc-63440ba08a39 req-dc363228-33cf-4fa2-98ed-94b94236d33b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-unplugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-373535d5-ebb5-48c1-b4dc-63440ba08a39 req-dc363228-33cf-4fa2-98ed-94b94236d33b service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-unplugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Instance destroyed successfully.
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.objects.instance [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'resources' on Instance uuid e640c20f-d2d0-4b48-b13c-8ee8b1af864b {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-135273876',display_name='tempest-ServerActionsTestOtherA-server-135273876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-135273876',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-x0kl6uu5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:30:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=e640c20f-d2d0-4b48-b13c-8ee8b1af864b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "address": "fa:16:3e:b9:7e:a0", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7931f0a9-de", "ovs_interfaceid": "7931f0a9-dea3-4cf1-91f4-1039b3866903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_vif [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7931f0a9-de, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea91ad4d-d68d-44d5-9d3e-3447e5394062) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:26 user nova-compute[76391]: INFO os_vif [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:7e:a0,bridge_name='br-int',has_traffic_filtering=True,id=7931f0a9-dea3-4cf1-91f4-1039b3866903,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7931f0a9-de')
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOUtySWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:33:26 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd761dd-fa62-4b9d-b154-6c9de1ff7878]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:33:26 user nova-compute[76391]: No targets found.
Nov 15 23:33:26 user nova-compute[76391]: iSNS:
Nov 15 23:33:26 user nova-compute[76391]: No targets found.
Nov 15 23:33:26 user nova-compute[76391]: STATIC:
Nov 15 23:33:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:33:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8
Nov 15 23:33:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:33:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:26 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:33:26 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:26 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:26 user nova-compute[76391]: FIRMWARE:
Nov 15 23:33:26 user nova-compute[76391]: No targets found.
Nov 15 23:33:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:33:26 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:33:26 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6375fb2-5540-4ab6-8331-d9d60b868320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa325a7f-e695-4237-96d4-a20c76e27918]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:26 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:26 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:26 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:26 user nova-compute[76391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 (non-flash)
Nov 15 23:33:26 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:26 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9760649510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8'): ({'sdd'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Removing single pathed devices sdd {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f63af6-05ca-4bfb-a9ac-842523dd0cd2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceef25e-1f20-4cf1-b656-50c09c510419]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Flushing IO for device /dev/sdd {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8c561e-9ca1-472f-8c16-573a53817090]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d2c183-821a-498f-9ea3-6755d20b5b2f]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23432646363336331', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1b270f9', '/dev/disk/by-id/scsi-1SCST_BIOa1b270f9-42dcc3c1b03e8914') {{(pid=86206) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efb22f2-d6f0-479a-b843-010bee79021b]: (4, None) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9f54b6-0ce9-4aaa-94af-3196d3c8ac6e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[434f4d9a-eca9-4f66-8f38-393d76670aab]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260]
Nov 15 23:33:26 user nova-compute[76391]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8, portal: 172.16.0.220,3260] successful.
Nov 15 23:33:26 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992b1ee7-6005-4918-9607-f77d35383bc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f288154d-55f7-4a7d-804e-b63d16ed8338]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] <== disconnect_volume: return (402ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:33:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Deleting instance files /opt/stack/data/nova/instances/e640c20f-d2d0-4b48-b13c-8ee8b1af864b_del
Nov 15 23:33:26 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Deletion of /opt/stack/data/nova/instances/e640c20f-d2d0-4b48-b13c-8ee8b1af864b_del complete
Nov 15 23:33:26 user nova-compute[76391]: INFO nova.compute.manager [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:26 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:33:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:33:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=24.7640380859375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-67983d0a-99f6-40cc-a7fb-5c7c6afdc563 req-02b152fc-138c-461e-aa66-221c91a880c0 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-67983d0a-99f6-40cc-a7fb-5c7c6afdc563 req-02b152fc-138c-461e-aa66-221c91a880c0 service nova] Acquiring lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-67983d0a-99f6-40cc-a7fb-5c7c6afdc563 req-02b152fc-138c-461e-aa66-221c91a880c0 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-67983d0a-99f6-40cc-a7fb-5c7c6afdc563 req-02b152fc-138c-461e-aa66-221c91a880c0 service nova] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-67983d0a-99f6-40cc-a7fb-5c7c6afdc563 req-02b152fc-138c-461e-aa66-221c91a880c0 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] No waiting events found dispatching network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:27 user nova-compute[76391]: WARNING nova.compute.manager [req-67983d0a-99f6-40cc-a7fb-5c7c6afdc563 req-02b152fc-138c-461e-aa66-221c91a880c0 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received unexpected event network-vif-plugged-7931f0a9-dea3-4cf1-91f4-1039b3866903 for instance with vm_state active and task_state deleting.
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:27 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Took 1.08 seconds to deallocate network for instance.
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-0393001c-1f3e-4592-98ae-55e0233fb6fe req-21d036b2-8054-4fe2-8853-cf1df7e2a596 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Received event network-vif-deleted-7931f0a9-dea3-4cf1-91f4-1039b3866903 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:27 user nova-compute[76391]: INFO nova.compute.manager [req-0393001c-1f3e-4592-98ae-55e0233fb6fe req-21d036b2-8054-4fe2-8853-cf1df7e2a596 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Neutron deleted interface 7931f0a9-dea3-4cf1-91f4-1039b3866903; detaching it from the instance and deleting it from the info cache
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-0393001c-1f3e-4592-98ae-55e0233fb6fe req-21d036b2-8054-4fe2-8853-cf1df7e2a596 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-0393001c-1f3e-4592-98ae-55e0233fb6fe req-21d036b2-8054-4fe2-8853-cf1df7e2a596 service nova] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Detach interface failed, port_id=7931f0a9-dea3-4cf1-91f4-1039b3866903, reason: Instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:33:29 user nova-compute[76391]: INFO nova.compute.manager [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Took 1.94 seconds to detach 1 volumes for instance.
Nov 15 23:33:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: e640c20f-d2d0-4b48-b13c-8ee8b1af864b] Deleting volume: 992b1ee7-6005-4918-9607-f77d35383bc8 {{(pid=76391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 23:33:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:30 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:33:30 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:33:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:30 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Deleted allocations for instance e640c20f-d2d0-4b48-b13c-8ee8b1af864b
Nov 15 23:33:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-56e394d0-90f4-48c0-878e-375cb59fc819 tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "e640c20f-d2d0-4b48-b13c-8ee8b1af864b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.225s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:33:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:33:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:35 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing instance network info cache due to event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:33:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] Acquiring lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:33:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] Acquired lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:33:35 user nova-compute[76391]: DEBUG nova.network.neutron [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:33:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:36 user nova-compute[76391]: INFO nova.compute.manager [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Detaching volume bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:33:36 user nova-compute[76391]: DEBUG nova.network.neutron [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updated VIF entry in instance network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG nova.network.neutron [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8333b3b-6354-408d-b360-85c848f20481 req-bb7eca33-3cef-4fc3-af05-9d0d3726cb53 service nova] Releasing lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:33:36 user nova-compute[76391]: INFO nova.virt.block_device [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Attempting to driver detach volume bc74c6dd-8f18-4c35-a0fc-72a567954344 from mountpoint /dev/vdb
Nov 15 23:33:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Attempting to detach device vdb from instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:33:36 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:33:36 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:33:36 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:33:36 user nova-compute[76391]:   <serial>bc74c6dd-8f18-4c35-a0fc-72a567954344</serial>
Nov 15 23:33:36 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:33:36 user nova-compute[76391]: </disk>
Nov 15 23:33:36 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:33:36 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully detached device vdb from instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f from the persistent domain config.
Nov 15 23:33:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:33:36 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:33:36 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:33:36 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:33:36 user nova-compute[76391]:   <serial>bc74c6dd-8f18-4c35-a0fc-72a567954344</serial>
Nov 15 23:33:36 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:33:36 user nova-compute[76391]: </disk>
Nov 15 23:33:36 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:33:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing instance network info cache due to event network-changed-ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:33:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] Acquiring lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:33:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] Acquired lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:33:37 user nova-compute[76391]: DEBUG nova.network.neutron [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Refreshing network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:33:38 user nova-compute[76391]: DEBUG nova.network.neutron [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updated VIF entry in instance network info cache for port ffb183fe-4372-4617-98a2-4e90975d4876. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:33:38 user nova-compute[76391]: DEBUG nova.network.neutron [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [{"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-76de5cd2-ce01-49ac-b62f-9818a0d05de7 req-213c6c49-9353-4d7f-b1da-cd34c7a3a386 service nova] Releasing lock "refresh_cache-b3fb89ce-7ba2-47c7-af46-7a0051332a0f" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:33:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:47 user nova-compute[76391]: INFO nova.compute.manager [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Unshelving
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'pci_requests' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'numa_topology' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:33:47 user nova-compute[76391]: INFO nova.compute.claims [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Claim successful on node user
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:47 user nova-compute[76391]: INFO nova.compute.manager [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Terminating instance
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-eff34c55-c9de-474a-bb9a-374115d2d824 req-4450fecb-e23c-459e-a3a3-a63bc6a5b580 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-unplugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-eff34c55-c9de-474a-bb9a-374115d2d824 req-4450fecb-e23c-459e-a3a3-a63bc6a5b580 service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-eff34c55-c9de-474a-bb9a-374115d2d824 req-4450fecb-e23c-459e-a3a3-a63bc6a5b580 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-eff34c55-c9de-474a-bb9a-374115d2d824 req-4450fecb-e23c-459e-a3a3-a63bc6a5b580 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-eff34c55-c9de-474a-bb9a-374115d2d824 req-4450fecb-e23c-459e-a3a3-a63bc6a5b580 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-unplugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-eff34c55-c9de-474a-bb9a-374115d2d824 req-4450fecb-e23c-459e-a3a3-a63bc6a5b580 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-unplugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:33:47 user nova-compute[76391]: INFO nova.network.neutron [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating port d4b7186b-3b0a-4262-853b-9212dc427199 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Instance destroyed successfully.
Nov 15 23:33:48 user nova-compute[76391]: DEBUG nova.objects.instance [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lazy-loading 'resources' on Instance uuid 3489fe22-21c6-4d85-9dca-8bb8d89212dc {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-322522751',display_name='tempest-AttachVolumeNegativeTest-server-322522751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-322522751',id=41,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6qxqW95iiT/Fq2AXyx2ZAOkeNO2q3YLDdcLGXkFfv3RRxcmmPYmfzUC0KLW8BrsDM3AEukJE/RA2NKZcLlD8WVbenHv2OTzWoDXAJFjehOdjypEIHk+8F6Bzr9YaDaSw==',key_name='tempest-keypair-2064401305',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0d9ceea4a4748c4a4524ffb24a56e97',ramdisk_id='',reservation_id='r-ymq6ka2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-511423013',owner_user_name='tempest-AttachVolumeNegativeTest-511423013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a0dc5a4052f4e9ebf3448d0ed5e5f2a',uuid=3489fe22-21c6-4d85-9dca-8bb8d89212dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converting VIF {"id": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "address": "fa:16:3e:92:fc:f0", "network": {"id": "995776a7-0a13-4639-a395-ecbd6bdbacb8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2041093986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d9ceea4a4748c4a4524ffb24a56e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd876d1a1-20", "ovs_interfaceid": "d876d1a1-206d-4400-a2c5-1e2cbfa0589d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:fc:f0,bridge_name='br-int',has_traffic_filtering=True,id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd876d1a1-20') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG os_vif [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:fc:f0,bridge_name='br-int',has_traffic_filtering=True,id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd876d1a1-20') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd876d1a1-20, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0211fb9a-b467-4c24-9059-70abcaf452b9) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: INFO os_vif [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:fc:f0,bridge_name='br-int',has_traffic_filtering=True,id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d,network=Network(995776a7-0a13-4639-a395-ecbd6bdbacb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd876d1a1-20')
Nov 15 23:33:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Deleting instance files /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc_del
Nov 15 23:33:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Deletion of /opt/stack/data/nova/instances/3489fe22-21c6-4d85-9dca-8bb8d89212dc_del complete
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: INFO nova.compute.manager [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 23:33:48 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:33:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquired lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:33:49 user nova-compute[76391]: DEBUG nova.network.neutron [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:33:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:50 user nova-compute[76391]: WARNING nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received unexpected event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with vm_state active and task_state deleting.
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:50 user nova-compute[76391]: WARNING nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received unexpected event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with vm_state active and task_state deleting.
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing instance network info cache due to event network-changed-d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Acquiring lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.network.neutron [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Releasing lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:33:50 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Creating image(s)
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.objects.instance [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Acquired lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Refreshing network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG nova.objects.base [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<80a0c2c9-85a3-4895-b5d8-8544e44a4f6c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "963d402708381c2327a6c6e0ea4b4655dff5d845" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "963d402708381c2327a6c6e0ea4b4655dff5d845" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:52 user nova-compute[76391]: WARNING nova.compute.manager [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received unexpected event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with vm_state active and task_state deleting.
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-deleted-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:52 user nova-compute[76391]: INFO nova.compute.manager [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Neutron deleted interface d876d1a1-206d-4400-a2c5-1e2cbfa0589d; detaching it from the instance and deleting it from the info cache
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8148250-5fa1-4649-addf-634b8f76d3f2 req-91314f3b-b185-47cd-80ac-f45126db5193 service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Detach interface failed, port_id=d876d1a1-206d-4400-a2c5-1e2cbfa0589d, reason: Instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:33:52 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Took 3.69 seconds to deallocate network for instance.
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.part --force-share --output=json" returned: 0 in 0.202s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.virt.images [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] 0de1950d-c13c-426a-a925-2914a9cc8aac was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.part /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updated VIF entry in instance network info cache for port d4b7186b-3b0a-4262-853b-9212dc427199. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Releasing lock "refresh_cache-80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:52 user nova-compute[76391]: WARNING nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received unexpected event network-vif-plugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with vm_state active and task_state deleting.
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-unplugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Acquiring lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] No waiting events found dispatching network-vif-unplugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-42afe509-6983-4e73-9c2a-22fabfb75106 req-13f7ebe4-ea5b-4a88-a168-3138bf791caa service nova] [instance: 3489fe22-21c6-4d85-9dca-8bb8d89212dc] Received event network-vif-unplugged-d876d1a1-206d-4400-a2c5-1e2cbfa0589d for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:33:52 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.926s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.part /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.converted" returned: 0 in 1.219s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:53 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Deleted allocations for instance 3489fe22-21c6-4d85-9dca-8bb8d89212dc
Nov 15 23:33:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-25034473-04f6-4e83-ac69-889c5b5c5088 tempest-AttachVolumeNegativeTest-511423013 tempest-AttachVolumeNegativeTest-511423013-project-member] Lock "3489fe22-21c6-4d85-9dca-8bb8d89212dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.163s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845.converted --force-share --output=json" returned: 0 in 0.253s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "963d402708381c2327a6c6e0ea4b4655dff5d845" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.006s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845 --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "963d402708381c2327a6c6e0ea4b4655dff5d845" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "963d402708381c2327a6c6e0ea4b4655dff5d845" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845 --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845,backing_fmt=raw /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845,backing_fmt=raw /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk 1073741824" returned: 0 in 0.084s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "963d402708381c2327a6c6e0ea4b4655dff5d845" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845 --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845 --force-share --output=json" returned: 0 in 0.220s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'migration_context' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG nova.objects.base [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<80a0c2c9-85a3-4895-b5d8-8544e44a4f6c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:33:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Rebasing disk image.
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c -F raw /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:56 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f is timed out.
Nov 15 23:33:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully detached device vdb from instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f from the live domain config.
Nov 15 23:33:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afbrhFVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:33:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb11090-221e-4400-bb8c-6d3643771e42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:33:56 user nova-compute[76391]: No targets found.
Nov 15 23:33:56 user nova-compute[76391]: iSNS:
Nov 15 23:33:56 user nova-compute[76391]: No targets found.
Nov 15 23:33:56 user nova-compute[76391]: STATIC:
Nov 15 23:33:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb
Nov 15 23:33:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374
Nov 15 23:33:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:33:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:33:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:56 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344
Nov 15 23:33:56 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:33:56 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:33:56 user nova-compute[76391]: FIRMWARE:
Nov 15 23:33:56 user nova-compute[76391]: No targets found.
Nov 15 23:33:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:33:56 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:33:56 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48066e-02b2-4273-b32a-5e76018eec94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa8b1ad-8688-4e3a-a503-c0038677c536]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374 (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:33:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374 (non-flash)
Nov 15 23:33:56 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:33:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97402edbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03fd441-297f-44cf-b8b8-81a27f86af40]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[950c5d47-5f8c-4b98-869b-ff5066b5b631]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d6a991-ded1-452f-bc2c-3cf9c7f11cd2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.098s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e6803-8566-40c3-aa2d-8370a41b7e5c]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[106d736d-db7c-4917-a0d1-a5b0c764ecf4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d1e47a-9779-4a59-a022-f4b5772a0143]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260]
Nov 15 23:33:57 user nova-compute[76391]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344, portal: 172.16.0.220,3260] successful.
Nov 15 23:33:57 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc74c6dd-8f18-4c35-a0fc-72a567954344 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcedd36-275a-49c5-84b8-a35599e4a618]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.537s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] <== disconnect_volume: return (539ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c -F raw /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk" returned: 0 in 2.910s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Ensure instance console log exists: /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Start _get_guest_xml network_info=[{"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4bef12bf5776b4c689b63a6c8e177c9e',container_format='bare',created_at=2023-11-15T23:31:54Z,direct_url=<?>,disk_format='qcow2',id=0de1950d-c13c-426a-a925-2914a9cc8aac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1243535592-shelved',owner='8145bb6c79f347f39e0a46758d3683ff',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T23:31:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:33:57 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:33:57 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4bef12bf5776b4c689b63a6c8e177c9e',container_format='bare',created_at=2023-11-15T23:31:54Z,direct_url=<?>,disk_format='qcow2',id=0de1950d-c13c-426a-a925-2914a9cc8aac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1243535592-shelved',owner='8145bb6c79f347f39e0a46758d3683ff',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T23:31:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.objects.instance [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.objects.base [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<80a0c2c9-85a3-4895-b5d8-8544e44a4f6c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1243535592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1243535592',id=38,image_ref='0de1950d-c13c-426a-a925-2914a9cc8aac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1914316400',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-4xpnjva7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member',shelved_at='2023-11-15T23:31:58.278610',shelved_host='user',shelved_image_id='0de1950d-c13c-426a-a925-2914a9cc8aac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=80a0c2c9-85a3-4895-b5d8-8544e44a4f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.objects.instance [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'pci_devices' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.objects.base [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Object Instance<80a0c2c9-85a3-4895-b5d8-8544e44a4f6c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:33:57 user nova-compute[76391]:   <uuid>80a0c2c9-85a3-4895-b5d8-8544e44a4f6c</uuid>
Nov 15 23:33:57 user nova-compute[76391]:   <name>instance-00000026</name>
Nov 15 23:33:57 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:33:57 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:33:57 user nova-compute[76391]:   <metadata>
Nov 15 23:33:57 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:33:57 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:33:57 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1243535592</nova:name>
Nov 15 23:33:57 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:33:57</nova:creationTime>
Nov 15 23:33:57 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:33:57 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:33:57 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:33:57 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:33:57 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:33:57 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:33:57 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:33:57 user nova-compute[76391]:       <nova:owner>
Nov 15 23:33:57 user nova-compute[76391]:         <nova:user uuid="e45a3062019c454d8cc5321e130f8286">tempest-AttachVolumeShelveTestJSON-959550804-project-member</nova:user>
Nov 15 23:33:57 user nova-compute[76391]:         <nova:project uuid="8145bb6c79f347f39e0a46758d3683ff">tempest-AttachVolumeShelveTestJSON-959550804</nova:project>
Nov 15 23:33:57 user nova-compute[76391]:       </nova:owner>
Nov 15 23:33:57 user nova-compute[76391]:       <nova:root type="image" uuid="0de1950d-c13c-426a-a925-2914a9cc8aac"/>
Nov 15 23:33:57 user nova-compute[76391]:       <nova:ports>
Nov 15 23:33:57 user nova-compute[76391]:         <nova:port uuid="d4b7186b-3b0a-4262-853b-9212dc427199">
Nov 15 23:33:57 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 23:33:57 user nova-compute[76391]:         </nova:port>
Nov 15 23:33:57 user nova-compute[76391]:       </nova:ports>
Nov 15 23:33:57 user nova-compute[76391]:     </nova:instance>
Nov 15 23:33:57 user nova-compute[76391]:   </metadata>
Nov 15 23:33:57 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:33:57 user nova-compute[76391]:     <system>
Nov 15 23:33:57 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:33:57 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:33:57 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:33:57 user nova-compute[76391]:       <entry name="serial">80a0c2c9-85a3-4895-b5d8-8544e44a4f6c</entry>
Nov 15 23:33:57 user nova-compute[76391]:       <entry name="uuid">80a0c2c9-85a3-4895-b5d8-8544e44a4f6c</entry>
Nov 15 23:33:57 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:33:57 user nova-compute[76391]:     </system>
Nov 15 23:33:57 user nova-compute[76391]:   </sysinfo>
Nov 15 23:33:57 user nova-compute[76391]:   <os>
Nov 15 23:33:57 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:33:57 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:33:57 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:33:57 user nova-compute[76391]:   </os>
Nov 15 23:33:57 user nova-compute[76391]:   <features>
Nov 15 23:33:57 user nova-compute[76391]:     <acpi/>
Nov 15 23:33:57 user nova-compute[76391]:     <apic/>
Nov 15 23:33:57 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:33:57 user nova-compute[76391]:   </features>
Nov 15 23:33:57 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:33:57 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:33:57 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:33:57 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:33:57 user nova-compute[76391]:   </clock>
Nov 15 23:33:57 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:33:57 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:33:57 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:33:57 user nova-compute[76391]:   </cpu>
Nov 15 23:33:57 user nova-compute[76391]:   <devices>
Nov 15 23:33:57 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:33:57 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:33:57 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk"/>
Nov 15 23:33:57 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:33:57 user nova-compute[76391]:     </disk>
Nov 15 23:33:57 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:33:57 user nova-compute[76391]:       <mac address="fa:16:3e:f0:b9:5d"/>
Nov 15 23:33:57 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:33:57 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:33:57 user nova-compute[76391]:       <target dev="tapd4b7186b-3b"/>
Nov 15 23:33:57 user nova-compute[76391]:     </interface>
Nov 15 23:33:57 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:33:57 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/console.log" append="off"/>
Nov 15 23:33:57 user nova-compute[76391]:     </serial>
Nov 15 23:33:57 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:33:57 user nova-compute[76391]:     <video>
Nov 15 23:33:57 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:33:57 user nova-compute[76391]:     </video>
Nov 15 23:33:57 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:33:57 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:33:57 user nova-compute[76391]:     </rng>
Nov 15 23:33:57 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:33:57 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:33:57 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:33:57 user nova-compute[76391]:     </memballoon>
Nov 15 23:33:57 user nova-compute[76391]:   </devices>
Nov 15 23:33:57 user nova-compute[76391]: </domain>
Nov 15 23:33:57 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1243535592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1243535592',id=38,image_ref='0de1950d-c13c-426a-a925-2914a9cc8aac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1914316400',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-4xpnjva7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member',shelved_at='2023-11-15T23:31:58.278610',shelved_host='user',shelved_image_id='0de1950d-c13c-426a-a925-2914a9cc8aac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=80a0c2c9-85a3-4895-b5d8-8544e44a4f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG os_vif [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66a4111c-4c1b-52d4-893d-33c8a76957c1', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4b7186b-3b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4b7186b-3b, col_values=(('qos', UUID('b277e86d-f3fb-4d55-b48b-ab354519c610')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4b7186b-3b, col_values=(('external_ids', {'iface-id': 'd4b7186b-3b0a-4262-853b-9212dc427199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:b9:5d', 'vm-uuid': '80a0c2c9-85a3-4895-b5d8-8544e44a4f6c'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:57 user nova-compute[76391]: INFO os_vif [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b')
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:33:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] No VIF found with MAC fa:16:3e:f0:b9:5d, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:33:58 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'flavor' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8dfa7e39-4ad5-4f9b-ad14-df77bb0708ba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.498s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-420374c7-bc34-4a6f-a5c5-dba374cc3071 req-a8f60a8c-e490-4019-a879-a874390f467e service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-420374c7-bc34-4a6f-a5c5-dba374cc3071 req-a8f60a8c-e490-4019-a879-a874390f467e service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-420374c7-bc34-4a6f-a5c5-dba374cc3071 req-a8f60a8c-e490-4019-a879-a874390f467e service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-420374c7-bc34-4a6f-a5c5-dba374cc3071 req-a8f60a8c-e490-4019-a879-a874390f467e service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-420374c7-bc34-4a6f-a5c5-dba374cc3071 req-a8f60a8c-e490-4019-a879-a874390f467e service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:33:59 user nova-compute[76391]: WARNING nova.compute.manager [req-420374c7-bc34-4a6f-a5c5-dba374cc3071 req-a8f60a8c-e490-4019-a879-a874390f467e service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received unexpected event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquired lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.network.neutron [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'info_cache' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.objects.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:33:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:33:59 user nova-compute[76391]: INFO nova.compute.claims [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Claim successful on node user
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.network.neutron [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Releasing lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:34:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:34:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance destroyed successfully.
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'resources' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.objects.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_vif [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b8989d-62, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.policy [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7822512a5a344405ad7ec0fe7f3aba35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e478c752c644aebfcbc4db437dfc5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=385498db-af52-44b6-a167-626a7e2c37f8) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: INFO os_vif [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62')
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlVbgBZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:34:00 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca467be-ce75-433f-aa0b-5287d0f618b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:34:00 user nova-compute[76391]: No targets found.
Nov 15 23:34:00 user nova-compute[76391]: iSNS:
Nov 15 23:34:00 user nova-compute[76391]: No targets found.
Nov 15 23:34:00 user nova-compute[76391]: STATIC:
Nov 15 23:34:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb
Nov 15 23:34:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:34:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:34:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374
Nov 15 23:34:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:34:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:34:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:34:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:34:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:34:00 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:34:00 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:34:00 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:34:00 user nova-compute[76391]: FIRMWARE:
Nov 15 23:34:00 user nova-compute[76391]: No targets found.
Nov 15 23:34:00 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:34:00 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:34:00 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[080f2f44-5d10-4251-8a8a-c6f3941c53b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:34:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Creating image(s)
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "/opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "/opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16521334-176c-4359-b0fb-946ef13e60d2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:00 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:34:00 user nova-compute[76391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374 (non-flash)
Nov 15 23:34:00 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:34:00 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:00 user nova-compute[76391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:34:00 user nova-compute[76391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbafdfa-19b4-44ba-8cce-649094879374 (non-flash)
Nov 15 23:34:00 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:34:00 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97604f3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe'): ({'sdi'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Removing single pathed devices sdi {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d9a764-4cc5-4fe8-b273-f1f15ae18b1a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30d304a-117c-486c-b4b3-e7c475b34933]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flushing IO for device /dev/sdi {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[436018bd-eb68-4574-8a13-a53fed9a3331]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c17b3e-6ac6-487d-9fc0-147338f564f6]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] SCSI volumes sdi have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee4272-413c-4c06-8f29-310724a46cfb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4f136-d9a4-438d-aaf0-8bb89eb670b8]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]
Nov 15 23:34:01 user nova-compute[76391]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.
Nov 15 23:34:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ed586f-57d0-4d77-bbaf-2552a7b293e8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== disconnect_volume: return (443ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Start _get_guest_xml network_info=[{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlVbgBZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '6be3d794-c793-4da2-bfa2-8547215014ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1f037e5-4825-4eb1-9100-a801decaebbe', 'serial': 'a1f037e5-4825-4eb1-9100-a801decaebbe'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '0b997008-43ca-41a2-aef6-1d8ef7a0e461', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'numa_topology' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.objects.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:34:01 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:34:01 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk 1073741824" returned: 0 in 0.065s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.objects.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlVbgBZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:34:01 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:34:01 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:34:01 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[991a9871-4727-4393-b690-5a0a1acbb4a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:34:01 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Successfully created port: cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82ff01b-02d1-4029-b0ce-ba574fb442a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe] added
Nov 15 23:34:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c254e52e-420f-46fb-a997-714834e3812a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a4c24d-9cc0-4db4-a9ee-452f617f3454]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlVbgBZE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-c7392600-6ac3-4045-99b4-2f171748f7ee req-9999dd3f-df4f-4b7d-a523-5f947fdd09bd service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c7392600-6ac3-4045-99b4-2f171748f7ee req-9999dd3f-df4f-4b7d-a523-5f947fdd09bd service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c7392600-6ac3-4045-99b4-2f171748f7ee req-9999dd3f-df4f-4b7d-a523-5f947fdd09bd service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c7392600-6ac3-4045-99b4-2f171748f7ee req-9999dd3f-df4f-4b7d-a523-5f947fdd09bd service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-c7392600-6ac3-4045-99b4-2f171748f7ee req-9999dd3f-df4f-4b7d-a523-5f947fdd09bd service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:01 user nova-compute[76391]: WARNING nova.compute.manager [req-c7392600-6ac3-4045-99b4-2f171748f7ee req-9999dd3f-df4f-4b7d-a523-5f947fdd09bd service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received unexpected event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlVbgBZE" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b1e7a-9c2a-4ad9-84a3-b651cdabcc27]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nlVbgBZE'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Cannot resize image /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Ensure instance console log exists: /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a897674-8710-41bb-8872-be89d378a64c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21212541-e05b-4067-b439-ae534d9493db]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:01 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:34:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:01 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:34:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8899a24f-12e8-4f78-b072-a934acdb960c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]
Nov 15 23:34:01 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.
Nov 15 23:34:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa5d4ea-2fa0-4d74-9cc5-5668be2893ed]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6458a01c-02e0-4daa-9707-90effcd7e814]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:01 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:34:01 user nova-compute[76391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:34:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:01 user nova-compute[76391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e607948-423b-4be1-be8e-aee5ca0d08cb (non-flash)
Nov 15 23:34:01 user nova-compute[76391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:34:01 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[879158cb-8d87-4f5f-9316-0b6858e0d52b]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:34:01 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlVbgBZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:34:02 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance spawned successfully.
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Successfully updated port: cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquired lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-changed-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Refreshing instance network info cache due to event network-changed-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] Acquiring lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-329408f9-592a-481a-8346-3144696b088b tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.295s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Updating instance_info_cache with network_info: [{"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Releasing lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Instance network_info: |[{"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] Acquired lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.neutron [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Refreshing network info cache for port cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Start _get_guest_xml network_info=[{"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:34:02 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:34:02 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-59780801',display_name='tempest-VolumesSnapshotTestJSON-instance-59780801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-59780801',id=42,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPPZQWLZN63fEk43rfNO5QOdReohVgqb893ArgGvIYTILGJbtzWl76CPS9JOjEZkeWnpIQyUWzGVCW++YUsXrz/1qb13d3m0eZWjPJkj4w73km6seyCxQDAgMz+G5LxpA==',key_name='tempest-keypair-685035764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e478c752c644aebfcbc4db437dfc5e',ramdisk_id='',reservation_id='r-ca3563ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2045009250',owner_user_name='tempest-VolumesSnapshotTestJSON-2045009250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7822512a5a344405ad7ec0fe7f3aba35',uuid=1b78215b-26a1-47f5-8f9c-2e9f25b5f0de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converting VIF {"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fb:68,bridge_name='br-int',has_traffic_filtering=True,id=cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceae0d7-e7') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:34:02 user nova-compute[76391]:   <uuid>1b78215b-26a1-47f5-8f9c-2e9f25b5f0de</uuid>
Nov 15 23:34:02 user nova-compute[76391]:   <name>instance-0000002a</name>
Nov 15 23:34:02 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:34:02 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:34:02 user nova-compute[76391]:   <metadata>
Nov 15 23:34:02 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:34:02 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-59780801</nova:name>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:34:02</nova:creationTime>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:34:02 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:34:02 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:owner>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:user uuid="7822512a5a344405ad7ec0fe7f3aba35">tempest-VolumesSnapshotTestJSON-2045009250-project-member</nova:user>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:project uuid="82e478c752c644aebfcbc4db437dfc5e">tempest-VolumesSnapshotTestJSON-2045009250</nova:project>
Nov 15 23:34:02 user nova-compute[76391]:       </nova:owner>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:ports>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:port uuid="cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab">
Nov 15 23:34:02 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:34:02 user nova-compute[76391]:         </nova:port>
Nov 15 23:34:02 user nova-compute[76391]:       </nova:ports>
Nov 15 23:34:02 user nova-compute[76391]:     </nova:instance>
Nov 15 23:34:02 user nova-compute[76391]:   </metadata>
Nov 15 23:34:02 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:34:02 user nova-compute[76391]:     <system>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="serial">1b78215b-26a1-47f5-8f9c-2e9f25b5f0de</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="uuid">1b78215b-26a1-47f5-8f9c-2e9f25b5f0de</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:34:02 user nova-compute[76391]:     </system>
Nov 15 23:34:02 user nova-compute[76391]:   </sysinfo>
Nov 15 23:34:02 user nova-compute[76391]:   <os>
Nov 15 23:34:02 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:34:02 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:34:02 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:34:02 user nova-compute[76391]:   </os>
Nov 15 23:34:02 user nova-compute[76391]:   <features>
Nov 15 23:34:02 user nova-compute[76391]:     <acpi/>
Nov 15 23:34:02 user nova-compute[76391]:     <apic/>
Nov 15 23:34:02 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:34:02 user nova-compute[76391]:   </features>
Nov 15 23:34:02 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:34:02 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:34:02 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:34:02 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:34:02 user nova-compute[76391]:   </clock>
Nov 15 23:34:02 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:34:02 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:34:02 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:34:02 user nova-compute[76391]:   </cpu>
Nov 15 23:34:02 user nova-compute[76391]:   <devices>
Nov 15 23:34:02 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:34:02 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:34:02 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk"/>
Nov 15 23:34:02 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:34:02 user nova-compute[76391]:     </disk>
Nov 15 23:34:02 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:34:02 user nova-compute[76391]:       <mac address="fa:16:3e:7a:fb:68"/>
Nov 15 23:34:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:34:02 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:34:02 user nova-compute[76391]:       <target dev="tapcceae0d7-e7"/>
Nov 15 23:34:02 user nova-compute[76391]:     </interface>
Nov 15 23:34:02 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:34:02 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/console.log" append="off"/>
Nov 15 23:34:02 user nova-compute[76391]:     </serial>
Nov 15 23:34:02 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:34:02 user nova-compute[76391]:     <video>
Nov 15 23:34:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:34:02 user nova-compute[76391]:     </video>
Nov 15 23:34:02 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:34:02 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:34:02 user nova-compute[76391]:     </rng>
Nov 15 23:34:02 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:34:02 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:34:02 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:34:02 user nova-compute[76391]:     </memballoon>
Nov 15 23:34:02 user nova-compute[76391]:   </devices>
Nov 15 23:34:02 user nova-compute[76391]: </domain>
Nov 15 23:34:02 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-59780801',display_name='tempest-VolumesSnapshotTestJSON-instance-59780801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-59780801',id=42,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPPZQWLZN63fEk43rfNO5QOdReohVgqb893ArgGvIYTILGJbtzWl76CPS9JOjEZkeWnpIQyUWzGVCW++YUsXrz/1qb13d3m0eZWjPJkj4w73km6seyCxQDAgMz+G5LxpA==',key_name='tempest-keypair-685035764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82e478c752c644aebfcbc4db437dfc5e',ramdisk_id='',reservation_id='r-ca3563ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2045009250',owner_user_name='tempest-VolumesSnapshotTestJSON-2045009250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7822512a5a344405ad7ec0fe7f3aba35',uuid=1b78215b-26a1-47f5-8f9c-2e9f25b5f0de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converting VIF {"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fb:68,bridge_name='br-int',has_traffic_filtering=True,id=cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceae0d7-e7') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG os_vif [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fb:68,bridge_name='br-int',has_traffic_filtering=True,id=cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceae0d7-e7') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3c8ff59-287d-5069-86bd-a9a1e4431758', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcceae0d7-e7, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcceae0d7-e7, col_values=(('qos', UUID('3cd1ae2d-1365-49da-ad79-1bd566f1a9e9')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcceae0d7-e7, col_values=(('external_ids', {'iface-id': 'cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:fb:68', 'vm-uuid': '1b78215b-26a1-47f5-8f9c-2e9f25b5f0de'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:02 user nova-compute[76391]: INFO os_vif [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fb:68,bridge_name='br-int',has_traffic_filtering=True,id=cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceae0d7-e7')
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No VIF found with MAC fa:16:3e:7a:fb:68, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '23463323862353032', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463323862353032', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'pci_devices' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.objects.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:34:02 user nova-compute[76391]:   <uuid>6be3d794-c793-4da2-bfa2-8547215014ca</uuid>
Nov 15 23:34:02 user nova-compute[76391]:   <name>instance-00000027</name>
Nov 15 23:34:02 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:34:02 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:34:02 user nova-compute[76391]:   <metadata>
Nov 15 23:34:02 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:34:02 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeTestJSON-server-1699613562</nova:name>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:34:01</nova:creationTime>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:34:02 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:34:02 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:owner>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:user uuid="efa0b862a4e54967ba27a6cc88bb5496">tempest-AttachVolumeTestJSON-1495860226-project-member</nova:user>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:project uuid="28f76509cb8a4588a018268eee3eb14a">tempest-AttachVolumeTestJSON-1495860226</nova:project>
Nov 15 23:34:02 user nova-compute[76391]:       </nova:owner>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:34:02 user nova-compute[76391]:       <nova:ports>
Nov 15 23:34:02 user nova-compute[76391]:         <nova:port uuid="e9b8989d-623b-41ab-afe4-80edc71bb67c">
Nov 15 23:34:02 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 23:34:02 user nova-compute[76391]:         </nova:port>
Nov 15 23:34:02 user nova-compute[76391]:       </nova:ports>
Nov 15 23:34:02 user nova-compute[76391]:     </nova:instance>
Nov 15 23:34:02 user nova-compute[76391]:   </metadata>
Nov 15 23:34:02 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:34:02 user nova-compute[76391]:     <system>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="serial">6be3d794-c793-4da2-bfa2-8547215014ca</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="uuid">6be3d794-c793-4da2-bfa2-8547215014ca</entry>
Nov 15 23:34:02 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:34:02 user nova-compute[76391]:     </system>
Nov 15 23:34:02 user nova-compute[76391]:   </sysinfo>
Nov 15 23:34:02 user nova-compute[76391]:   <os>
Nov 15 23:34:02 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:34:02 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:34:02 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:34:02 user nova-compute[76391]:   </os>
Nov 15 23:34:02 user nova-compute[76391]:   <features>
Nov 15 23:34:02 user nova-compute[76391]:     <acpi/>
Nov 15 23:34:02 user nova-compute[76391]:     <apic/>
Nov 15 23:34:02 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:34:02 user nova-compute[76391]:   </features>
Nov 15 23:34:02 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:34:02 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:34:02 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:34:02 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:34:02 user nova-compute[76391]:   </clock>
Nov 15 23:34:02 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:34:02 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:34:02 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:34:02 user nova-compute[76391]:   </cpu>
Nov 15 23:34:02 user nova-compute[76391]:   <devices>
Nov 15 23:34:02 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:34:02 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:34:02 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk"/>
Nov 15 23:34:02 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:34:02 user nova-compute[76391]:     </disk>
Nov 15 23:34:02 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:34:02 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:34:02 user nova-compute[76391]:       <source dev="/dev/sdc"/>
Nov 15 23:34:02 user nova-compute[76391]:       <target dev="vdb" bus="virtio"/>
Nov 15 23:34:02 user nova-compute[76391]:       <serial>a1f037e5-4825-4eb1-9100-a801decaebbe</serial>
Nov 15 23:34:02 user nova-compute[76391]:     </disk>
Nov 15 23:34:02 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:34:02 user nova-compute[76391]:       <mac address="fa:16:3e:ec:71:f6"/>
Nov 15 23:34:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:34:02 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:34:02 user nova-compute[76391]:       <target dev="tape9b8989d-62"/>
Nov 15 23:34:02 user nova-compute[76391]:     </interface>
Nov 15 23:34:02 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:34:02 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/console.log" append="off"/>
Nov 15 23:34:02 user nova-compute[76391]:     </serial>
Nov 15 23:34:02 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:34:02 user nova-compute[76391]:     <video>
Nov 15 23:34:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:34:02 user nova-compute[76391]:     </video>
Nov 15 23:34:02 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:34:02 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:34:02 user nova-compute[76391]:     </rng>
Nov 15 23:34:02 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:34:02 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:34:02 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:34:02 user nova-compute[76391]:     </memballoon>
Nov 15 23:34:02 user nova-compute[76391]:   </devices>
Nov 15 23:34:02 user nova-compute[76391]: </domain>
Nov 15 23:34:02 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:34:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.network.neutron [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Updated VIF entry in instance network info cache for port cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.network.neutron [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Updating instance_info_cache with network_info: [{"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-de779035-b884-48db-89a0-297c144a5836 req-4ecbd036-5739-4b0d-be94-6fd9fd45fca9 service nova] Releasing lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.objects.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Cannot resize image /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.objects.instance [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'migration_context' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.objects.base [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG os_vif [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dddcd68-4d91-56a8-b254-ab6f5f826b2b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b8989d-62, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9b8989d-62, col_values=(('qos', UUID('1a200f19-83ef-45c3-b66a-1e667f15cc77')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9b8989d-62, col_values=(('external_ids', {'iface-id': 'e9b8989d-623b-41ab-afe4-80edc71bb67c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:71:f6', 'vm-uuid': '6be3d794-c793-4da2-bfa2-8547215014ca'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:03 user nova-compute[76391]: INFO os_vif [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62')
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-fb06d771-4e6b-4ce9-9fab-dcde7b0904aa req-ed90ed77-bdd0-45c6-bff7-7f37ce668943 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fb06d771-4e6b-4ce9-9fab-dcde7b0904aa req-ed90ed77-bdd0-45c6-bff7-7f37ce668943 service nova] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fb06d771-4e6b-4ce9-9fab-dcde7b0904aa req-ed90ed77-bdd0-45c6-bff7-7f37ce668943 service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fb06d771-4e6b-4ce9-9fab-dcde7b0904aa req-ed90ed77-bdd0-45c6-bff7-7f37ce668943 service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG nova.compute.manager [req-fb06d771-4e6b-4ce9-9fab-dcde7b0904aa req-ed90ed77-bdd0-45c6-bff7-7f37ce668943 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] No waiting events found dispatching network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:04 user nova-compute[76391]: WARNING nova.compute.manager [req-fb06d771-4e6b-4ce9-9fab-dcde7b0904aa req-ed90ed77-bdd0-45c6-bff7-7f37ce668943 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received unexpected event network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab for instance with vm_state building and task_state spawning.
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] No waiting events found dispatching network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:06 user nova-compute[76391]: WARNING nova.compute.manager [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received unexpected event network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab for instance with vm_state building and task_state spawning.
Nov 15 23:34:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG nova.compute.manager [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:06 user nova-compute[76391]: WARNING nova.compute.manager [req-ea78f543-75d8-46d7-b60b-42aa1e880c76 req-c34ddb18-bd8b-49d4-b257-36655e337c7c service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state stopped and task_state powering-on.
Nov 15 23:34:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:07 user nova-compute[76391]: INFO nova.compute.manager [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Terminating instance
Nov 15 23:34:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Instance destroyed successfully.
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.objects.instance [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'resources' on Instance uuid 0c0d5ecf-3d9e-4715-87a4-16726b37f10c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369691657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369691657',id=30,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:24:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-wljmn2l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:26:42Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=0c0d5ecf-3d9e-4715-87a4-16726b37f10c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "f9e27487-509b-42b5-abaa-ce5111dad89a", "address": "fa:16:3e:f1:24:75", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e27487-50", "ovs_interfaceid": "f9e27487-509b-42b5-abaa-ce5111dad89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:24:75,bridge_name='br-int',has_traffic_filtering=True,id=f9e27487-509b-42b5-abaa-ce5111dad89a,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e27487-50') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG os_vif [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:24:75,bridge_name='br-int',has_traffic_filtering=True,id=f9e27487-509b-42b5-abaa-ce5111dad89a,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e27487-50') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9e27487-50, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6e7d52e-ca68-40e2-bbc8-594378332a5c) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:08 user nova-compute[76391]: INFO os_vif [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:24:75,bridge_name='br-int',has_traffic_filtering=True,id=f9e27487-509b-42b5-abaa-ce5111dad89a,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e27487-50')
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Deleting instance files /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c_del
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Deletion of /opt/stack/data/nova/instances/0c0d5ecf-3d9e-4715-87a4-16726b37f10c_del complete
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.compute.manager [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance rebooted successfully.
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-21b97754-089c-4d11-bd98-6427e282c2e1 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Instance spawned successfully.
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:08 user nova-compute[76391]: WARNING nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state stopped and task_state powering-on.
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received event network-vif-unplugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] No waiting events found dispatching network-vif-unplugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received event network-vif-unplugged-f9e27487-509b-42b5-abaa-ce5111dad89a for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received event network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Acquiring lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] No waiting events found dispatching network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:08 user nova-compute[76391]: WARNING nova.compute.manager [req-8de8e8ec-2fef-48d1-bff1-aadd2c6f64b1 req-82e6d86e-6f9c-4fa3-b122-37938c204d17 service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received unexpected event network-vif-plugged-f9e27487-509b-42b5-abaa-ce5111dad89a for instance with vm_state active and task_state deleting.
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Took 7.92 seconds to spawn the instance on the hypervisor.
Nov 15 23:34:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:34:08 user nova-compute[76391]: INFO nova.compute.manager [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Took 8.90 seconds to build instance.
Nov 15 23:34:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e124f0ec-2be2-4a9d-a1d7-437037bb4ecd tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.139s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:09 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:09 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Took 1.14 seconds to deallocate network for instance.
Nov 15 23:34:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:09 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:34:10 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:34:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:10 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Deleted allocations for instance 0c0d5ecf-3d9e-4715-87a4-16726b37f10c
Nov 15 23:34:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-846f062c-ced4-48f6-9935-45aaa75a2ef9 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "0c0d5ecf-3d9e-4715-87a4-16726b37f10c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.810s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:10 user nova-compute[76391]: DEBUG nova.compute.manager [req-48144833-0bb6-4428-b928-9ff32afb8af1 req-773f83a5-303d-4f26-a895-13c8265630cc service nova] [instance: 0c0d5ecf-3d9e-4715-87a4-16726b37f10c] Received event network-vif-deleted-f9e27487-509b-42b5-abaa-ce5111dad89a {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:18 user nova-compute[76391]: INFO nova.compute.manager [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Terminating instance
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.compute.manager [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-79df230c-9081-4f15-9182-c76ea6002fbe req-f22be931-fd93-4dc5-86ec-debcc8bccd5e service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-vif-unplugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79df230c-9081-4f15-9182-c76ea6002fbe req-f22be931-fd93-4dc5-86ec-debcc8bccd5e service nova] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79df230c-9081-4f15-9182-c76ea6002fbe req-f22be931-fd93-4dc5-86ec-debcc8bccd5e service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79df230c-9081-4f15-9182-c76ea6002fbe req-f22be931-fd93-4dc5-86ec-debcc8bccd5e service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-79df230c-9081-4f15-9182-c76ea6002fbe req-f22be931-fd93-4dc5-86ec-debcc8bccd5e service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] No waiting events found dispatching network-vif-unplugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.compute.manager [req-79df230c-9081-4f15-9182-c76ea6002fbe req-f22be931-fd93-4dc5-86ec-debcc8bccd5e service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-vif-unplugged-a0e36bda-f671-4e95-8488-e500b017cbb4 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:34:18 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Instance destroyed successfully.
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.objects.instance [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lazy-loading 'resources' on Instance uuid 6626d0d5-79ae-433b-aa6f-94e69353c7d3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-203507033',display_name='tempest-ServerActionsTestOtherA-server-203507033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-203507033',id=2,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/UPx+A9eJKkzQbfOqWP1yyW3k5ZChF81BboflKYUbwvmTYewFPh7ctQ6MgvoJWR+gh0QobXnOkNIhN0Az1q6FokHmg5oXUb1o0MnFE9bx4qgwGRDLY/kcDLDbMS1HgBQ==',key_name='tempest-keypair-174563627',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:15:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='472379097b584f5da5aa8f5c919f2e82',ramdisk_id='',reservation_id='r-dosqdayd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1370446029',owner_user_name='tempest-ServerActionsTestOtherA-1370446029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:15:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9170a4bb51b41d289416bb371c98a3b',uuid=6626d0d5-79ae-433b-aa6f-94e69353c7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converting VIF {"id": "a0e36bda-f671-4e95-8488-e500b017cbb4", "address": "fa:16:3e:f5:5b:71", "network": {"id": "fc99a7a3-71c1-4285-8995-9ebe661b4a0d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-257918397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "472379097b584f5da5aa8f5c919f2e82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e36bda-f6", "ovs_interfaceid": "a0e36bda-f671-4e95-8488-e500b017cbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5b:71,bridge_name='br-int',has_traffic_filtering=True,id=a0e36bda-f671-4e95-8488-e500b017cbb4,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e36bda-f6') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG os_vif [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5b:71,bridge_name='br-int',has_traffic_filtering=True,id=a0e36bda-f671-4e95-8488-e500b017cbb4,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e36bda-f6') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0e36bda-f6, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fa4c49f-47b7-4a54-9dc0-a44db34b1fe5) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:19 user nova-compute[76391]: INFO os_vif [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5b:71,bridge_name='br-int',has_traffic_filtering=True,id=a0e36bda-f671-4e95-8488-e500b017cbb4,network=Network(fc99a7a3-71c1-4285-8995-9ebe661b4a0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e36bda-f6')
Nov 15 23:34:19 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Deleting instance files /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3_del
Nov 15 23:34:19 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Deletion of /opt/stack/data/nova/instances/6626d0d5-79ae-433b-aa6f-94e69353c7d3_del complete
Nov 15 23:34:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:19 user nova-compute[76391]: INFO nova.compute.manager [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 15 23:34:19 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG nova.compute.manager [req-1fe007e1-1f73-4e15-a0e1-7767420c342a req-bfc469ae-0c32-41e1-8787-8166a94f1e31 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-vif-deleted-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:19 user nova-compute[76391]: INFO nova.compute.manager [req-1fe007e1-1f73-4e15-a0e1-7767420c342a req-bfc469ae-0c32-41e1-8787-8166a94f1e31 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Neutron deleted interface a0e36bda-f671-4e95-8488-e500b017cbb4; detaching it from the instance and deleting it from the info cache
Nov 15 23:34:19 user nova-compute[76391]: DEBUG nova.network.neutron [req-1fe007e1-1f73-4e15-a0e1-7767420c342a req-bfc469ae-0c32-41e1-8787-8166a94f1e31 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:19 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Took 0.61 seconds to deallocate network for instance.
Nov 15 23:34:19 user nova-compute[76391]: DEBUG nova.compute.manager [req-1fe007e1-1f73-4e15-a0e1-7767420c342a req-bfc469ae-0c32-41e1-8787-8166a94f1e31 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Detach interface failed, port_id=a0e36bda-f671-4e95-8488-e500b017cbb4, reason: Instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:19 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:20 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Deleted allocations for instance 6626d0d5-79ae-433b-aa6f-94e69353c7d3
Nov 15 23:34:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b4bd6b4e-c7c4-49b3-a5d2-815952875dab tempest-ServerActionsTestOtherA-1370446029 tempest-ServerActionsTestOtherA-1370446029-project-member] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-1d75b6e1-8b49-4d14-a7a3-06353fdd71e1 req-f5dc3510-86df-4128-ab12-69bcbb239077 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received event network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1d75b6e1-8b49-4d14-a7a3-06353fdd71e1 req-f5dc3510-86df-4128-ab12-69bcbb239077 service nova] Acquiring lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1d75b6e1-8b49-4d14-a7a3-06353fdd71e1 req-f5dc3510-86df-4128-ab12-69bcbb239077 service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-1d75b6e1-8b49-4d14-a7a3-06353fdd71e1 req-f5dc3510-86df-4128-ab12-69bcbb239077 service nova] Lock "6626d0d5-79ae-433b-aa6f-94e69353c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:20 user nova-compute[76391]: DEBUG nova.compute.manager [req-1d75b6e1-8b49-4d14-a7a3-06353fdd71e1 req-f5dc3510-86df-4128-ab12-69bcbb239077 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] No waiting events found dispatching network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:20 user nova-compute[76391]: WARNING nova.compute.manager [req-1d75b6e1-8b49-4d14-a7a3-06353fdd71e1 req-f5dc3510-86df-4128-ab12-69bcbb239077 service nova] [instance: 6626d0d5-79ae-433b-aa6f-94e69353c7d3] Received unexpected event network-vif-plugged-a0e36bda-f671-4e95-8488-e500b017cbb4 for instance with vm_state deleted and task_state None.
Nov 15 23:34:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:23 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:34:26 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=7740MB free_disk=24.919422149658203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:26 user nova-compute[76391]: INFO nova.compute.manager [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Terminating instance
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d1c8427a-7299-4332-82eb-afc545cb6f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-6948331f-e78e-4d4a-9cd6-b1e9276fb0fa req-ae568d55-b2ae-457b-ac96-56736d0738b1 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6948331f-e78e-4d4a-9cd6-b1e9276fb0fa req-ae568d55-b2ae-457b-ac96-56736d0738b1 service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6948331f-e78e-4d4a-9cd6-b1e9276fb0fa req-ae568d55-b2ae-457b-ac96-56736d0738b1 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6948331f-e78e-4d4a-9cd6-b1e9276fb0fa req-ae568d55-b2ae-457b-ac96-56736d0738b1 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-6948331f-e78e-4d4a-9cd6-b1e9276fb0fa req-ae568d55-b2ae-457b-ac96-56736d0738b1 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.manager [req-6948331f-e78e-4d4a-9cd6-b1e9276fb0fa req-ae568d55-b2ae-457b-ac96-56736d0738b1 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-unplugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:34:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Instance destroyed successfully.
Nov 15 23:34:27 user nova-compute[76391]: DEBUG nova.objects.instance [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'resources' on Instance uuid b3fb89ce-7ba2-47c7-af46-7a0051332a0f {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-981583528',display_name='tempest-ServerRescueNegativeTestJSON-server-981583528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-981583528',id=35,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIomkJe45ki1cIYUkPS1QNjMQCyBktjIJXwWsY7ulKFg7nff4Bz84pHhi23s1LSsAqYsBwfT0r/bsl3OIKzBSg3EyL31y7rTJAmPX658xmYM1Ec9jZsHDP4Fs215Jaumkg==',key_name='tempest-keypair-935125858',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-i1klz6my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:31:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3986dd9981e24a0f8faf441662255bab',uuid=b3fb89ce-7ba2-47c7-af46-7a0051332a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "ffb183fe-4372-4617-98a2-4e90975d4876", "address": "fa:16:3e:d9:b7:a7", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb183fe-43", "ovs_interfaceid": "ffb183fe-4372-4617-98a2-4e90975d4876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG os_vif [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffb183fe-43, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=436276dd-6e95-479b-adea-bdd9b221de28) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:27 user nova-compute[76391]: INFO os_vif [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=ffb183fe-4372-4617-98a2-4e90975d4876,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb183fe-43')
Nov 15 23:34:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Deleting instance files /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f_del
Nov 15 23:34:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Deletion of /opt/stack/data/nova/instances/b3fb89ce-7ba2-47c7-af46-7a0051332a0f_del complete
Nov 15 23:34:27 user nova-compute[76391]: INFO nova.compute.manager [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 23:34:27 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:34:27 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:28 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Took 0.87 seconds to deallocate network for instance.
Nov 15 23:34:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:28 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Deleted allocations for instance b3fb89ce-7ba2-47c7-af46-7a0051332a0f
Nov 15 23:34:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-d35ff0b9-0e7f-4b95-8135-511a5196610e req-7fd0067b-aa7b-4073-bbaa-a2c9560e5214 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d35ff0b9-0e7f-4b95-8135-511a5196610e req-7fd0067b-aa7b-4073-bbaa-a2c9560e5214 service nova] Acquiring lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d35ff0b9-0e7f-4b95-8135-511a5196610e req-7fd0067b-aa7b-4073-bbaa-a2c9560e5214 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d35ff0b9-0e7f-4b95-8135-511a5196610e req-7fd0067b-aa7b-4073-bbaa-a2c9560e5214 service nova] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-d35ff0b9-0e7f-4b95-8135-511a5196610e req-7fd0067b-aa7b-4073-bbaa-a2c9560e5214 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] No waiting events found dispatching network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:28 user nova-compute[76391]: WARNING nova.compute.manager [req-d35ff0b9-0e7f-4b95-8135-511a5196610e req-7fd0067b-aa7b-4073-bbaa-a2c9560e5214 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received unexpected event network-vif-plugged-ffb183fe-4372-4617-98a2-4e90975d4876 for instance with vm_state deleted and task_state None.
Nov 15 23:34:28 user nova-compute[76391]: DEBUG nova.compute.manager [req-d35ff0b9-0e7f-4b95-8135-511a5196610e req-7fd0067b-aa7b-4073-bbaa-a2c9560e5214 service nova] [instance: b3fb89ce-7ba2-47c7-af46-7a0051332a0f] Received event network-vif-deleted-ffb183fe-4372-4617-98a2-4e90975d4876 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-00e3fec6-4b03-40b3-977e-d52037b37dba tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "b3fb89ce-7ba2-47c7-af46-7a0051332a0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:34:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:34:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:34:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:34:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:34:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:34:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:34:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:34:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:58 user nova-compute[76391]: INFO nova.compute.manager [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Terminating instance
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.compute.manager [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-c6b5647a-287b-4173-95cb-323ffd34ec51 req-281ec8e2-96e0-49d0-9f32-affc5160890b service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c6b5647a-287b-4173-95cb-323ffd34ec51 req-281ec8e2-96e0-49d0-9f32-affc5160890b service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c6b5647a-287b-4173-95cb-323ffd34ec51 req-281ec8e2-96e0-49d0-9f32-affc5160890b service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c6b5647a-287b-4173-95cb-323ffd34ec51 req-281ec8e2-96e0-49d0-9f32-affc5160890b service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-c6b5647a-287b-4173-95cb-323ffd34ec51 req-281ec8e2-96e0-49d0-9f32-affc5160890b service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-c6b5647a-287b-4173-95cb-323ffd34ec51 req-281ec8e2-96e0-49d0-9f32-affc5160890b service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-unplugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Instance destroyed successfully.
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.objects.instance [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'resources' on Instance uuid 4559c90b-6fb9-4190-8d40-0832c743c2c7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173822820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173822820',id=15,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-xcuqv6hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:22:56Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=4559c90b-6fb9-4190-8d40-0832c743c2c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "6553aad5-cc35-490e-95dc-96d4b144728c", "address": "fa:16:3e:2f:58:72", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6553aad5-cc", "ovs_interfaceid": "6553aad5-cc35-490e-95dc-96d4b144728c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_vif [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6553aad5-cc, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0f8f0a7-df74-4764-b8c0-7d77e0960f02) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:34:58 user nova-compute[76391]: INFO os_vif [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:58:72,bridge_name='br-int',has_traffic_filtering=True,id=6553aad5-cc35-490e-95dc-96d4b144728c,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6553aad5-cc')
Nov 15 23:34:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YndmToLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:34:58 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80c4c9b-0634-4581-9212-67f9b9b33284]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:34:58 user nova-compute[76391]: No targets found.
Nov 15 23:34:58 user nova-compute[76391]: iSNS:
Nov 15 23:34:58 user nova-compute[76391]: No targets found.
Nov 15 23:34:58 user nova-compute[76391]: STATIC:
Nov 15 23:34:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:34:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:34:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:34:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd
Nov 15 23:34:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:34:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:34:58 user nova-compute[76391]: FIRMWARE:
Nov 15 23:34:58 user nova-compute[76391]: No targets found.
Nov 15 23:34:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:34:58 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:34:58 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f936f65-24de-4d2f-aa63-976e230be199]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b677a-c7ab-4f2d-b448-910a4c0d8d64]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:58 user nova-compute[76391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:34:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd (non-flash)
Nov 15 23:34:58 user nova-compute[76391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:34:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97603896c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d9d25e-7485-4723-92a2-847f3d579187]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c4e40-c400-40d4-9976-a112998545ab]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d9363e-3f05-442d-915b-adbeae7ed946]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:34:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea766cb-dde0-4020-9a4e-9645912926ab]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b1cf9-d95f-486c-ab15-aaa77ce7e294]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fc5192-7216-409b-973e-4572034e203b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260]
Nov 15 23:34:59 user nova-compute[76391]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd, portal: 172.16.0.220,3260] successful.
Nov 15 23:34:59 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:283d147a-4ff2-4fea-a7fb-ee4113eaa7cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2eac8c-ba3c-48f9-91b2-380400828835]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] <== disconnect_volume: return (317ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:34:59 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Deleting instance files /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7_del
Nov 15 23:34:59 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Deletion of /opt/stack/data/nova/instances/4559c90b-6fb9-4190-8d40-0832c743c2c7_del complete
Nov 15 23:34:59 user nova-compute[76391]: INFO nova.compute.manager [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 23:34:59 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:59 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Took 0.49 seconds to deallocate network for instance.
Nov 15 23:34:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-bfaad42e-cd89-4b1f-a052-02091d7abfc6 req-8dd71c99-ed80-4aeb-b372-96d05dbb08ae service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-deleted-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:34:59 user nova-compute[76391]: INFO nova.compute.manager [req-bfaad42e-cd89-4b1f-a052-02091d7abfc6 req-8dd71c99-ed80-4aeb-b372-96d05dbb08ae service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Neutron deleted interface 6553aad5-cc35-490e-95dc-96d4b144728c; detaching it from the instance and deleting it from the info cache
Nov 15 23:34:59 user nova-compute[76391]: DEBUG nova.network.neutron [req-bfaad42e-cd89-4b1f-a052-02091d7abfc6 req-8dd71c99-ed80-4aeb-b372-96d05dbb08ae service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:34:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-bfaad42e-cd89-4b1f-a052-02091d7abfc6 req-8dd71c99-ed80-4aeb-b372-96d05dbb08ae service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Detach interface failed, port_id=6553aad5-cc35-490e-95dc-96d4b144728c, reason: Instance 4559c90b-6fb9-4190-8d40-0832c743c2c7 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-6ef23ecd-7371-4dcc-828c-2fbb32f7b1a4 req-3cfc3f74-c1f2-47a6-a487-5f9c0d76a73c service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6ef23ecd-7371-4dcc-828c-2fbb32f7b1a4 req-3cfc3f74-c1f2-47a6-a487-5f9c0d76a73c service nova] Acquiring lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6ef23ecd-7371-4dcc-828c-2fbb32f7b1a4 req-3cfc3f74-c1f2-47a6-a487-5f9c0d76a73c service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6ef23ecd-7371-4dcc-828c-2fbb32f7b1a4 req-3cfc3f74-c1f2-47a6-a487-5f9c0d76a73c service nova] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-6ef23ecd-7371-4dcc-828c-2fbb32f7b1a4 req-3cfc3f74-c1f2-47a6-a487-5f9c0d76a73c service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] No waiting events found dispatching network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:00 user nova-compute[76391]: WARNING nova.compute.manager [req-6ef23ecd-7371-4dcc-828c-2fbb32f7b1a4 req-3cfc3f74-c1f2-47a6-a487-5f9c0d76a73c service nova] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Received unexpected event network-vif-plugged-6553aad5-cc35-490e-95dc-96d4b144728c for instance with vm_state active and task_state deleting.
Nov 15 23:35:00 user nova-compute[76391]: INFO nova.compute.manager [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 4559c90b-6fb9-4190-8d40-0832c743c2c7] Took 0.81 seconds to detach 1 volumes for instance.
Nov 15 23:35:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:35:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:00 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Deleted allocations for instance 4559c90b-6fb9-4190-8d40-0832c743c2c7
Nov 15 23:35:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0c4c04c3-1613-4b3f-b171-d4ac6ca57318 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "4559c90b-6fb9-4190-8d40-0832c743c2c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:35:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:35:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:35:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:35:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:21 user nova-compute[76391]: INFO nova.compute.manager [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Terminating instance
Nov 15 23:35:21 user nova-compute[76391]: DEBUG nova.compute.manager [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-5cdcc64a-6668-4d38-94b8-31e94107ed91 req-538f4ebb-b567-434b-a150-06933b15b6da service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-unplugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5cdcc64a-6668-4d38-94b8-31e94107ed91 req-538f4ebb-b567-434b-a150-06933b15b6da service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5cdcc64a-6668-4d38-94b8-31e94107ed91 req-538f4ebb-b567-434b-a150-06933b15b6da service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5cdcc64a-6668-4d38-94b8-31e94107ed91 req-538f4ebb-b567-434b-a150-06933b15b6da service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-5cdcc64a-6668-4d38-94b8-31e94107ed91 req-538f4ebb-b567-434b-a150-06933b15b6da service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-unplugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.compute.manager [req-5cdcc64a-6668-4d38-94b8-31e94107ed91 req-538f4ebb-b567-434b-a150-06933b15b6da service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-unplugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Instance destroyed successfully.
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'resources' on Instance uuid d1c8427a-7299-4332-82eb-afc545cb6f8d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-893601650',display_name='tempest-ServerRescueNegativeTestJSON-server-893601650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-893601650',id=18,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-owkocc4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:21:19Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=d1c8427a-7299-4332-82eb-afc545cb6f8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "address": "fa:16:3e:82:66:f3", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20833cf0-a0", "ovs_interfaceid": "20833cf0-a0ae-4ea9-ad8d-d9f002e6f092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG os_vif [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20833cf0-a0, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f496dcb-7372-40ad-928b-07699d52a5eb) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:35:22 user nova-compute[76391]: INFO os_vif [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:66:f3,bridge_name='br-int',has_traffic_filtering=True,id=20833cf0-a0ae-4ea9-ad8d-d9f002e6f092,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20833cf0-a0')
Nov 15 23:35:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Deleting instance files /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d_del
Nov 15 23:35:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Deletion of /opt/stack/data/nova/instances/d1c8427a-7299-4332-82eb-afc545cb6f8d_del complete
Nov 15 23:35:22 user nova-compute[76391]: INFO nova.compute.manager [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 23:35:22 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:35:23 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Took 0.54 seconds to deallocate network for instance.
Nov 15 23:35:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-cf355139-e5b1-4118-97f8-dc9a5568bf26 req-96e570de-f94b-46a7-ba29-577ebd4ec549 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-deleted-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:35:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:23 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Deleted allocations for instance d1c8427a-7299-4332-82eb-afc545cb6f8d
Nov 15 23:35:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6e9f58da-176f-4149-ac44-3365cc7a8a96 tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.895s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:24 user nova-compute[76391]: WARNING nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state deleted and task_state None.
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:24 user nova-compute[76391]: WARNING nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state deleted and task_state None.
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Acquiring lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] Lock "d1c8427a-7299-4332-82eb-afc545cb6f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] No waiting events found dispatching network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:24 user nova-compute[76391]: WARNING nova.compute.manager [req-0e8c35b7-5305-40b6-85ad-f33c34f6baae req-4c28d8da-4b11-42b0-a020-41db7ba04ae4 service nova] [instance: d1c8427a-7299-4332-82eb-afc545cb6f8d] Received unexpected event network-vif-plugged-20833cf0-a0ae-4ea9-ad8d-d9f002e6f092 for instance with vm_state deleted and task_state None.
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [{"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-1e599e64-0ce6-4a2e-93c0-89add58a0c1a" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:24 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:25 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:35:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8298MB free_disk=24.960426330566406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance bfb44f27-ed01-4f78-a982-5302163e5069 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:35:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:35:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:35:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:35:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:34 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:34 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:37 user nova-compute[76391]: INFO nova.compute.manager [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Terminating instance
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-91e11b6b-ccbd-4701-bda0-40cc5e84f877 req-b240a60c-69a5-46ce-a74e-d5cc17b5544b service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-unplugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91e11b6b-ccbd-4701-bda0-40cc5e84f877 req-b240a60c-69a5-46ce-a74e-d5cc17b5544b service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91e11b6b-ccbd-4701-bda0-40cc5e84f877 req-b240a60c-69a5-46ce-a74e-d5cc17b5544b service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91e11b6b-ccbd-4701-bda0-40cc5e84f877 req-b240a60c-69a5-46ce-a74e-d5cc17b5544b service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-91e11b6b-ccbd-4701-bda0-40cc5e84f877 req-b240a60c-69a5-46ce-a74e-d5cc17b5544b service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-unplugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.compute.manager [req-91e11b6b-ccbd-4701-bda0-40cc5e84f877 req-b240a60c-69a5-46ce-a74e-d5cc17b5544b service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-unplugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Instance destroyed successfully.
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lazy-loading 'resources' on Instance uuid 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T23:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1243535592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1243535592',id=38,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdbfGGv5EeyneUZURLXjRY2yTJ9CO3AUtVZfrZykUhK+aboka7jRiPibMIDsnB6QsaVUABdNRiFp9ZCGnjTWZI/H4y1pZkfK0sb54p1ToZcJn51z96MAbQ9FbGzZ+df7Q==',key_name='tempest-keypair-1914316400',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:34:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8145bb6c79f347f39e0a46758d3683ff',ramdisk_id='',reservation_id='r-4xpnjva7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959550804',owner_user_name='tempest-AttachVolumeShelveTestJSON-959550804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e45a3062019c454d8cc5321e130f8286',uuid=80a0c2c9-85a3-4895-b5d8-8544e44a4f6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converting VIF {"id": "d4b7186b-3b0a-4262-853b-9212dc427199", "address": "fa:16:3e:f0:b9:5d", "network": {"id": "ba272512-a5b0-4c52-95a8-44035ed0ba63", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-13417758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8145bb6c79f347f39e0a46758d3683ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b7186b-3b", "ovs_interfaceid": "d4b7186b-3b0a-4262-853b-9212dc427199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG os_vif [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4b7186b-3b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b277e86d-f3fb-4d55-b48b-ab354519c610) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:37 user nova-compute[76391]: INFO os_vif [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b9:5d,bridge_name='br-int',has_traffic_filtering=True,id=d4b7186b-3b0a-4262-853b-9212dc427199,network=Network(ba272512-a5b0-4c52-95a8-44035ed0ba63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b7186b-3b')
Nov 15 23:35:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Deleting instance files /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c_del
Nov 15 23:35:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Deletion of /opt/stack/data/nova/instances/80a0c2c9-85a3-4895-b5d8-8544e44a4f6c_del complete
Nov 15 23:35:37 user nova-compute[76391]: INFO nova.compute.manager [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 15 23:35:37 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:35:37 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:35:39 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Took 1.26 seconds to deallocate network for instance.
Nov 15 23:35:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-6820267e-2299-4371-88f8-962519df7361 req-941f6da6-8a9f-4bff-a4c6-cd9b56cfe3e2 service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-deleted-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-8244e79b-68ee-429a-b0ac-40dda0a43d03 req-127b3f6d-fe55-41cc-836e-1fefe1aa91fd service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8244e79b-68ee-429a-b0ac-40dda0a43d03 req-127b3f6d-fe55-41cc-836e-1fefe1aa91fd service nova] Acquiring lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8244e79b-68ee-429a-b0ac-40dda0a43d03 req-127b3f6d-fe55-41cc-836e-1fefe1aa91fd service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8244e79b-68ee-429a-b0ac-40dda0a43d03 req-127b3f6d-fe55-41cc-836e-1fefe1aa91fd service nova] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-8244e79b-68ee-429a-b0ac-40dda0a43d03 req-127b3f6d-fe55-41cc-836e-1fefe1aa91fd service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] No waiting events found dispatching network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:39 user nova-compute[76391]: WARNING nova.compute.manager [req-8244e79b-68ee-429a-b0ac-40dda0a43d03 req-127b3f6d-fe55-41cc-836e-1fefe1aa91fd service nova] [instance: 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c] Received unexpected event network-vif-plugged-d4b7186b-3b0a-4262-853b-9212dc427199 for instance with vm_state deleted and task_state None.
Nov 15 23:35:39 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Deleted allocations for instance 80a0c2c9-85a3-4895-b5d8-8544e44a4f6c
Nov 15 23:35:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9af4c970-2c68-40b5-be36-1b41dec3767a tempest-AttachVolumeShelveTestJSON-959550804 tempest-AttachVolumeShelveTestJSON-959550804-project-member] Lock "80a0c2c9-85a3-4895-b5d8-8544e44a4f6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:35:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:35:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:35:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:35:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:35:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:48 user nova-compute[76391]: INFO nova.compute.manager [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Terminating instance
Nov 15 23:35:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-d56eeed5-5269-44b4-91c2-45bc9cc9bfa4 req-812b3504-5fe4-48df-ae46-dde63908ff74 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received event network-vif-unplugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d56eeed5-5269-44b4-91c2-45bc9cc9bfa4 req-812b3504-5fe4-48df-ae46-dde63908ff74 service nova] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d56eeed5-5269-44b4-91c2-45bc9cc9bfa4 req-812b3504-5fe4-48df-ae46-dde63908ff74 service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d56eeed5-5269-44b4-91c2-45bc9cc9bfa4 req-812b3504-5fe4-48df-ae46-dde63908ff74 service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-d56eeed5-5269-44b4-91c2-45bc9cc9bfa4 req-812b3504-5fe4-48df-ae46-dde63908ff74 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] No waiting events found dispatching network-vif-unplugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:48 user nova-compute[76391]: DEBUG nova.compute.manager [req-d56eeed5-5269-44b4-91c2-45bc9cc9bfa4 req-812b3504-5fe4-48df-ae46-dde63908ff74 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received event network-vif-unplugged-8d742d76-5324-4921-9cf9-8f8487f04de5 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:35:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Instance destroyed successfully.
Nov 15 23:35:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lazy-loading 'resources' on Instance uuid 1e599e64-0ce6-4a2e-93c0-89add58a0c1a {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-201123848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-201123848',id=1,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:15:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c28a381270e4f489acbbc7702c64c61',ramdisk_id='',reservation_id='r-7ofgkvjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-194934661',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:17:17Z,user_data=None,user_id='323a9405e8854778bf826678f8ae876f',uuid=1e599e64-0ce6-4a2e-93c0-89add58a0c1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converting VIF {"id": "8d742d76-5324-4921-9cf9-8f8487f04de5", "address": "fa:16:3e:5c:45:b8", "network": {"id": "8dba7be5-341e-4d60-8d32-90c1924074f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-377139384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c28a381270e4f489acbbc7702c64c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d742d76-53", "ovs_interfaceid": "8d742d76-5324-4921-9cf9-8f8487f04de5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:45:b8,bridge_name='br-int',has_traffic_filtering=True,id=8d742d76-5324-4921-9cf9-8f8487f04de5,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d742d76-53') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG os_vif [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:45:b8,bridge_name='br-int',has_traffic_filtering=True,id=8d742d76-5324-4921-9cf9-8f8487f04de5,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d742d76-53') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d742d76-53, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57b8a11f-a922-4d91-9cfa-63cdf5bbc8bc) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:49 user nova-compute[76391]: INFO os_vif [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:45:b8,bridge_name='br-int',has_traffic_filtering=True,id=8d742d76-5324-4921-9cf9-8f8487f04de5,network=Network(8dba7be5-341e-4d60-8d32-90c1924074f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d742d76-53')
Nov 15 23:35:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Deleting instance files /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a_del
Nov 15 23:35:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Deletion of /opt/stack/data/nova/instances/1e599e64-0ce6-4a2e-93c0-89add58a0c1a_del complete
Nov 15 23:35:49 user nova-compute[76391]: INFO nova.compute.manager [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 23:35:49 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:35:49 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:35:50 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Took 0.47 seconds to deallocate network for instance.
Nov 15 23:35:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-9f9b3001-0a01-4ae7-b4eb-e309b5758e8b req-4ade3baa-8516-406d-b6f4-c5d3fef1d28f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received event network-vif-deleted-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:50 user nova-compute[76391]: INFO nova.compute.manager [req-9f9b3001-0a01-4ae7-b4eb-e309b5758e8b req-4ade3baa-8516-406d-b6f4-c5d3fef1d28f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Neutron deleted interface 8d742d76-5324-4921-9cf9-8f8487f04de5; detaching it from the instance and deleting it from the info cache
Nov 15 23:35:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-9f9b3001-0a01-4ae7-b4eb-e309b5758e8b req-4ade3baa-8516-406d-b6f4-c5d3fef1d28f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-9f9b3001-0a01-4ae7-b4eb-e309b5758e8b req-4ade3baa-8516-406d-b6f4-c5d3fef1d28f service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Detach interface failed, port_id=8d742d76-5324-4921-9cf9-8f8487f04de5, reason: Instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:50 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Deleted allocations for instance 1e599e64-0ce6-4a2e-93c0-89add58a0c1a
Nov 15 23:35:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-9f17afa5-8b23-4672-9e8a-62f0a0aa43d4 tempest-ServerBootFromVolumeStableRescueTest-194934661 tempest-ServerBootFromVolumeStableRescueTest-194934661-project-member] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:50 user nova-compute[76391]: INFO nova.compute.manager [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Detaching volume a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:35:50 user nova-compute[76391]: INFO nova.virt.block_device [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Attempting to driver detach volume a1f037e5-4825-4eb1-9100-a801decaebbe from mountpoint /dev/vdb
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Attempting to detach device vdb from instance 6be3d794-c793-4da2-bfa2-8547215014ca from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:35:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:35:51 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:35:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:35:51 user nova-compute[76391]:   <serial>a1f037e5-4825-4eb1-9100-a801decaebbe</serial>
Nov 15 23:35:51 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:35:51 user nova-compute[76391]: </disk>
Nov 15 23:35:51 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:35:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully detached device vdb from instance 6be3d794-c793-4da2-bfa2-8547215014ca from the persistent domain config.
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6be3d794-c793-4da2-bfa2-8547215014ca from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:35:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:35:51 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:35:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:35:51 user nova-compute[76391]:   <serial>a1f037e5-4825-4eb1-9100-a801decaebbe</serial>
Nov 15 23:35:51 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 23:35:51 user nova-compute[76391]: </disk>
Nov 15 23:35:51 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-93bb9d97-8445-4254-8ecc-afc741299e41 req-9a8186d0-01cc-454f-b5b8-c02f5d21dcd6 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received event network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-93bb9d97-8445-4254-8ecc-afc741299e41 req-9a8186d0-01cc-454f-b5b8-c02f5d21dcd6 service nova] Acquiring lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-93bb9d97-8445-4254-8ecc-afc741299e41 req-9a8186d0-01cc-454f-b5b8-c02f5d21dcd6 service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-93bb9d97-8445-4254-8ecc-afc741299e41 req-9a8186d0-01cc-454f-b5b8-c02f5d21dcd6 service nova] Lock "1e599e64-0ce6-4a2e-93c0-89add58a0c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-93bb9d97-8445-4254-8ecc-afc741299e41 req-9a8186d0-01cc-454f-b5b8-c02f5d21dcd6 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] No waiting events found dispatching network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:35:51 user nova-compute[76391]: WARNING nova.compute.manager [req-93bb9d97-8445-4254-8ecc-afc741299e41 req-9a8186d0-01cc-454f-b5b8-c02f5d21dcd6 service nova] [instance: 1e599e64-0ce6-4a2e-93c0-89add58a0c1a] Received unexpected event network-vif-plugged-8d742d76-5324-4921-9cf9-8f8487f04de5 for instance with vm_state deleted and task_state None.
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-changed-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Refreshing instance network info cache due to event network-changed-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] Acquiring lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] Acquired lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Refreshing network info cache for port cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'flavor' on Instance uuid 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:35:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Ignoring supplied device name: /dev/vdb
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:35:51 user nova-compute[76391]: INFO nova.compute.manager [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Attaching volume e3919563-2926-43fb-ad02-7bb7cd8484ea to /dev/vdb
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Updated VIF entry in instance network info cache for port cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Updating instance_info_cache with network_info: [{"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG os_brick.utils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9b418fe5-8e2a-4024-ae8f-36bc516842d8 req-45ab38fc-a581-4c55-bddd-f5965f6aa0d3 service nova] Releasing lock "refresh_cache-1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823fe3d-9826-4707-b3ed-b2873045de25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c0f48-aa07-4921-8236-70b9187aa308]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c81992-79b2-4858-8713-54d9653a53ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae22d198-065c-4a93-bc5e-67f887b35e16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:35:51 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:35:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d45069-bac9-4cf5-926b-835f1fb37fe1]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG os_brick.utils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:35:51 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Updating existing volume attachment record: 52f9c393-11cc-4104-a490-bb0965a38af5 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:35:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCHXAaIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:35:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:35:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:35:56 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca507c46-536e-4ee6-8d0a-1f83c4c269fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:35:56 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e46804-09f9-4155-a2e2-8bfee6442db7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea] added
Nov 15 23:35:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8383ccaf-a7e3-44e6-a853-1fe14f08f173]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec79e3f2-e4b8-46df-b9e7-2bc06b2dc501]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCHXAaIq {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCHXAaIq" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a4a2f-9189-4f48-b5dc-d5add2f3eca9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uCHXAaIq'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d58882-af0b-4504-b328-db7e4f3ab572]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f82b3e-e87e-47b0-a7a7-9b5cb4653a69]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:35:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:35:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b648ec2-6185-4404-ab17-33298794dd66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260]
Nov 15 23:35:56 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260] successful.
Nov 15 23:35:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b65057-2eba-4803-911c-1ac8e398d9dd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83655110-de10-4ee1-beed-3653bda07c32]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:35:56 user nova-compute[76391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)
Nov 15 23:35:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:35:56 user nova-compute[76391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)
Nov 15 23:35:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b62bd7-e3c1-49cd-aab1-cd1649bbff60]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:35:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCHXAaIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:35:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:35:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26131333765343361', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:35:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131333765343361', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:35:57 user nova-compute[76391]: DEBUG nova.objects.instance [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'flavor' on Instance uuid 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:35:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:35:57 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:35:57 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:35:57 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:35:57 user nova-compute[76391]:   <serial>e3919563-2926-43fb-ad02-7bb7cd8484ea</serial>
Nov 15 23:35:57 user nova-compute[76391]: </disk>
Nov 15 23:35:57 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:35:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:35:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:35:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] No VIF found with MAC fa:16:3e:7a:fb:68, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:35:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-6b1510c8-eec2-4c37-a990-e12e827e905f tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.785s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:35:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:36:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:36:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:36:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:10 user nova-compute[76391]: INFO nova.compute.manager [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Detaching volume e3919563-2926-43fb-ad02-7bb7cd8484ea
Nov 15 23:36:10 user nova-compute[76391]: INFO nova.virt.block_device [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Attempting to driver detach volume e3919563-2926-43fb-ad02-7bb7cd8484ea from mountpoint /dev/vdb
Nov 15 23:36:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Attempting to detach device vdb from instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:36:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:36:10 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:36:10 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:36:10 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:36:10 user nova-compute[76391]:   <serial>e3919563-2926-43fb-ad02-7bb7cd8484ea</serial>
Nov 15 23:36:10 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:36:10 user nova-compute[76391]: </disk>
Nov 15 23:36:10 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:36:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully detached device vdb from instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de from the persistent domain config.
Nov 15 23:36:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:36:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:36:10 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:36:10 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:36:10 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:36:10 user nova-compute[76391]:   <serial>e3919563-2926-43fb-ad02-7bb7cd8484ea</serial>
Nov 15 23:36:10 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:36:10 user nova-compute[76391]: </disk>
Nov 15 23:36:10 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:36:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:36:11 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6be3d794-c793-4da2-bfa2-8547215014ca is timed out.
Nov 15 23:36:11 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully detached device vdb from instance 6be3d794-c793-4da2-bfa2-8547215014ca from the live domain config.
Nov 15 23:36:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlVbgBZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:36:11 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b258e70-f1a6-4df3-8203-f66cefbf9810]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:36:11 user nova-compute[76391]: No targets found.
Nov 15 23:36:11 user nova-compute[76391]: iSNS:
Nov 15 23:36:11 user nova-compute[76391]: No targets found.
Nov 15 23:36:11 user nova-compute[76391]: STATIC:
Nov 15 23:36:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea
Nov 15 23:36:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:36:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:36:11 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe
Nov 15 23:36:11 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:36:11 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:36:11 user nova-compute[76391]: FIRMWARE:
Nov 15 23:36:11 user nova-compute[76391]: No targets found.
Nov 15 23:36:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:36:11 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:36:11 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e3dfea-ec75-44fe-a6ca-705d37d944b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbfbb6b-3789-450a-9db8-4d251be41ce9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:36:11 user nova-compute[76391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)
Nov 15 23:36:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe (non-flash)
Nov 15 23:36:11 user nova-compute[76391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)
Nov 15 23:36:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97402f6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[871a1b56-9d10-45a3-bde3-60ac5392af99]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd61b6e7-b280-4645-9ef1-a8deb6147ff5]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d464aef-e2ae-4b94-8d9d-74d637c17423]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d177f1-d7e8-4ed1-b255-be5e87adcbb2]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9bb75f-307b-40db-a4f1-9f9f26368985]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[584245c7-296e-415d-afa9-665940916f21]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260]
Nov 15 23:36:11 user nova-compute[76391]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe, portal: 172.16.0.220,3260] successful.
Nov 15 23:36:11 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f037e5-4825-4eb1-9100-a801decaebbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd1a81-6e2d-427a-b2d6-e51ba08bd5ce]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== disconnect_volume: return (312ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:36:11 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c9b89a70-f673-448c-adb2-b613acf70ec5 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.609s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:12 user nova-compute[76391]: INFO nova.compute.manager [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Terminating instance
Nov 15 23:36:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-e7e447a8-4554-4477-81ba-889a7c53e930 req-abaccce2-ac54-473c-b1f4-576da0d6c6aa service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e7e447a8-4554-4477-81ba-889a7c53e930 req-abaccce2-ac54-473c-b1f4-576da0d6c6aa service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e7e447a8-4554-4477-81ba-889a7c53e930 req-abaccce2-ac54-473c-b1f4-576da0d6c6aa service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e7e447a8-4554-4477-81ba-889a7c53e930 req-abaccce2-ac54-473c-b1f4-576da0d6c6aa service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-e7e447a8-4554-4477-81ba-889a7c53e930 req-abaccce2-ac54-473c-b1f4-576da0d6c6aa service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:36:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-e7e447a8-4554-4477-81ba-889a7c53e930 req-abaccce2-ac54-473c-b1f4-576da0d6c6aa service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-unplugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Instance destroyed successfully.
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lazy-loading 'resources' on Instance uuid bfb44f27-ed01-4f78-a982-5302163e5069 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1775411528',display_name='tempest-ServerRescueNegativeTestJSON-server-1775411528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1775411528',id=17,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d522b2994d4474999b1a2d2d474c74b',ramdisk_id='',reservation_id='r-xj9j2eo7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1623431733',owner_user_name='tempest-ServerRescueNegativeTestJSON-1623431733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:26:02Z,user_data=None,user_id='3986dd9981e24a0f8faf441662255bab',uuid=bfb44f27-ed01-4f78-a982-5302163e5069,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converting VIF {"id": "914d7841-8a90-461e-83d6-efd74735dc0e", "address": "fa:16:3e:2b:dd:a0", "network": {"id": "3993c3f4-3832-4943-9980-49d62b939c1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981391463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d522b2994d4474999b1a2d2d474c74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914d7841-8a", "ovs_interfaceid": "914d7841-8a90-461e-83d6-efd74735dc0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG os_vif [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap914d7841-8a, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36af603f-e36d-4189-bd4e-fae8e4c1997a) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:13 user nova-compute[76391]: INFO os_vif [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:dd:a0,bridge_name='br-int',has_traffic_filtering=True,id=914d7841-8a90-461e-83d6-efd74735dc0e,network=Network(3993c3f4-3832-4943-9980-49d62b939c1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914d7841-8a')
Nov 15 23:36:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Deleting instance files /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069_del
Nov 15 23:36:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Deletion of /opt/stack/data/nova/instances/bfb44f27-ed01-4f78-a982-5302163e5069_del complete
Nov 15 23:36:13 user nova-compute[76391]: INFO nova.compute.manager [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 23:36:13 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0da1d92c-4a4e-4a91-84b5-3f9edc99f1e4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0da1d92c-4a4e-4a91-84b5-3f9edc99f1e4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-0da1d92c-4a4e-4a91-84b5-3f9edc99f1e4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-0da1d92c-4a4e-4a91-84b5-3f9edc99f1e4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76391) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-0da1d92c-4a4e-4a91-84b5-3f9edc99f1e4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-6de58286-9daa-4403-be22-338148006e7c req-d84bbe4e-2033-416d-8d18-8fdf64c30046 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6de58286-9daa-4403-be22-338148006e7c req-d84bbe4e-2033-416d-8d18-8fdf64c30046 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6de58286-9daa-4403-be22-338148006e7c req-d84bbe4e-2033-416d-8d18-8fdf64c30046 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-6de58286-9daa-4403-be22-338148006e7c req-d84bbe4e-2033-416d-8d18-8fdf64c30046 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-6de58286-9daa-4403-be22-338148006e7c req-d84bbe4e-2033-416d-8d18-8fdf64c30046 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:36:13 user nova-compute[76391]: WARNING nova.compute.manager [req-6de58286-9daa-4403-be22-338148006e7c req-d84bbe4e-2033-416d-8d18-8fdf64c30046 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state active and task_state powering-off.
Nov 15 23:36:14 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:36:14 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Took 0.64 seconds to deallocate network for instance.
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:36:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance destroyed successfully.
Nov 15 23:36:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-0da1d92c-4a4e-4a91-84b5-3f9edc99f1e4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:14 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Deleted allocations for instance bfb44f27-ed01-4f78-a982-5302163e5069
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0da1d92c-4a4e-4a91-84b5-3f9edc99f1e4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.888s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f7185c08-6887-42f3-9c35-5b2d222244ce tempest-ServerRescueNegativeTestJSON-1623431733 tempest-ServerRescueNegativeTestJSON-1623431733-project-member] Lock "bfb44f27-ed01-4f78-a982-5302163e5069" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.869s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-632028ca-ed94-4582-bdc6-476126c7d027 req-8816d122-f030-44d2-835a-f583549a3784 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-632028ca-ed94-4582-bdc6-476126c7d027 req-8816d122-f030-44d2-835a-f583549a3784 service nova] Acquiring lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-632028ca-ed94-4582-bdc6-476126c7d027 req-8816d122-f030-44d2-835a-f583549a3784 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-632028ca-ed94-4582-bdc6-476126c7d027 req-8816d122-f030-44d2-835a-f583549a3784 service nova] Lock "bfb44f27-ed01-4f78-a982-5302163e5069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-632028ca-ed94-4582-bdc6-476126c7d027 req-8816d122-f030-44d2-835a-f583549a3784 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] No waiting events found dispatching network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:36:14 user nova-compute[76391]: WARNING nova.compute.manager [req-632028ca-ed94-4582-bdc6-476126c7d027 req-8816d122-f030-44d2-835a-f583549a3784 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received unexpected event network-vif-plugged-914d7841-8a90-461e-83d6-efd74735dc0e for instance with vm_state deleted and task_state None.
Nov 15 23:36:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-50e6f570-5e2d-43d5-9c40-841133939815 req-c9d90de2-9b46-4dfe-9c2d-f1e02d11eeb0 service nova] [instance: bfb44f27-ed01-4f78-a982-5302163e5069] Received event network-vif-deleted-914d7841-8a90-461e-83d6-efd74735dc0e {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-50e6f570-5e2d-43d5-9c40-841133939815 req-c9d90de2-9b46-4dfe-9c2d-f1e02d11eeb0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-50e6f570-5e2d-43d5-9c40-841133939815 req-c9d90de2-9b46-4dfe-9c2d-f1e02d11eeb0 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-50e6f570-5e2d-43d5-9c40-841133939815 req-c9d90de2-9b46-4dfe-9c2d-f1e02d11eeb0 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-50e6f570-5e2d-43d5-9c40-841133939815 req-c9d90de2-9b46-4dfe-9c2d-f1e02d11eeb0 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-50e6f570-5e2d-43d5-9c40-841133939815 req-c9d90de2-9b46-4dfe-9c2d-f1e02d11eeb0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:36:15 user nova-compute[76391]: WARNING nova.compute.manager [req-50e6f570-5e2d-43d5-9c40-841133939815 req-c9d90de2-9b46-4dfe-9c2d-f1e02d11eeb0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state stopped and task_state None.
Nov 15 23:36:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:36:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:36:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:36:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:26 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:36:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:36:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:36:26 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:36:28 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.137813568115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:36:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:30 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de is timed out.
Nov 15 23:36:30 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully detached device vdb from instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de from the live domain config.
Nov 15 23:36:30 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCHXAaIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:36:30 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b504ae-9a29-4e2c-9c31-fb640c02d8e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:36:30 user nova-compute[76391]: No targets found.
Nov 15 23:36:30 user nova-compute[76391]: iSNS:
Nov 15 23:36:30 user nova-compute[76391]: No targets found.
Nov 15 23:36:30 user nova-compute[76391]: STATIC:
Nov 15 23:36:30 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea
Nov 15 23:36:30 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:36:30 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:36:30 user nova-compute[76391]: FIRMWARE:
Nov 15 23:36:30 user nova-compute[76391]: No targets found.
Nov 15 23:36:30 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:36:30 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:36:30 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5cb8b3-9455-4176-bdbb-5fe687be9191]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c1b70-4d6d-472a-b68b-788a2a355e6e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)
Nov 15 23:36:30 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:36:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea (non-flash)
Nov 15 23:36:30 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97604f2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3aa650-9817-4a96-a52e-c9a6914f3846]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8183037c-65e5-4549-9d98-6aa49ff5db7b]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3989074-8ff7-4cb1-8bcc-8536424908e4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a195d0-f86d-4bcd-abed-f243d3430d30]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb711fe9-e396-45e3-baa3-820ff9490e71]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a31ad7-8565-46a6-90ac-c81cf9f98700]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260]
Nov 15 23:36:31 user nova-compute[76391]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea, portal: 172.16.0.220,3260] successful.
Nov 15 23:36:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a032df6-4a6b-4db4-a89a-89aeb8db2cd2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== disconnect_volume: return (336ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:36:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.objects.instance [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'flavor' on Instance uuid 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-afa2edce-ddbf-4912-aa4e-9b78f85e48d9 tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.857s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.734s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:32 user nova-compute[76391]: INFO nova.compute.manager [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Terminating instance
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-8ef6781d-008b-49ca-bcaa-ca98657e2cfb req-fe461d13-d3cd-40a2-b4c3-5888b3a89571 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-vif-unplugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8ef6781d-008b-49ca-bcaa-ca98657e2cfb req-fe461d13-d3cd-40a2-b4c3-5888b3a89571 service nova] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8ef6781d-008b-49ca-bcaa-ca98657e2cfb req-fe461d13-d3cd-40a2-b4c3-5888b3a89571 service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8ef6781d-008b-49ca-bcaa-ca98657e2cfb req-fe461d13-d3cd-40a2-b4c3-5888b3a89571 service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-8ef6781d-008b-49ca-bcaa-ca98657e2cfb req-fe461d13-d3cd-40a2-b4c3-5888b3a89571 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] No waiting events found dispatching network-vif-unplugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.compute.manager [req-8ef6781d-008b-49ca-bcaa-ca98657e2cfb req-fe461d13-d3cd-40a2-b4c3-5888b3a89571 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-vif-unplugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:36:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Instance destroyed successfully.
Nov 15 23:36:32 user nova-compute[76391]: DEBUG nova.objects.instance [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lazy-loading 'resources' on Instance uuid 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-59780801',display_name='tempest-VolumesSnapshotTestJSON-instance-59780801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-59780801',id=42,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPPZQWLZN63fEk43rfNO5QOdReohVgqb893ArgGvIYTILGJbtzWl76CPS9JOjEZkeWnpIQyUWzGVCW++YUsXrz/1qb13d3m0eZWjPJkj4w73km6seyCxQDAgMz+G5LxpA==',key_name='tempest-keypair-685035764',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82e478c752c644aebfcbc4db437dfc5e',ramdisk_id='',reservation_id='r-ca3563ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2045009250',owner_user_name='tempest-VolumesSnapshotTestJSON-2045009250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:34:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7822512a5a344405ad7ec0fe7f3aba35',uuid=1b78215b-26a1-47f5-8f9c-2e9f25b5f0de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converting VIF {"id": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "address": "fa:16:3e:7a:fb:68", "network": {"id": "e36beb2b-feed-4aaa-9330-d4ff59caa576", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1431103376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82e478c752c644aebfcbc4db437dfc5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceae0d7-e7", "ovs_interfaceid": "cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:fb:68,bridge_name='br-int',has_traffic_filtering=True,id=cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceae0d7-e7') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG os_vif [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:fb:68,bridge_name='br-int',has_traffic_filtering=True,id=cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceae0d7-e7') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcceae0d7-e7, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cd1ae2d-1365-49da-ad79-1bd566f1a9e9) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:33 user nova-compute[76391]: INFO os_vif [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:fb:68,bridge_name='br-int',has_traffic_filtering=True,id=cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab,network=Network(e36beb2b-feed-4aaa-9330-d4ff59caa576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceae0d7-e7')
Nov 15 23:36:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:e3919563-2926-43fb-ad02-7bb7cd8484ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCHXAaIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:36:33 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:36:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[bea002ae-f03a-4ed1-b700-7d450a4e8eb2]: Unexpected error while running command.
Nov 15 23:36:33 user nova-compute[76391]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 23:36:33 user nova-compute[76391]: Exit code: 21
Nov 15 23:36:33 user nova-compute[76391]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 23:36:33 user nova-compute[76391]: Stderr: '' {{(pid=86206) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 15 23:36:33 user nova-compute[76391]: Traceback (most recent call last):
Nov 15 23:36:33 user nova-compute[76391]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 15 23:36:33 user nova-compute[76391]:     ret = func(*f_args, **f_kwargs)
Nov 15 23:36:33 user nova-compute[76391]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 15 23:36:33 user nova-compute[76391]:     return func(*args, **kwargs)
Nov 15 23:36:33 user nova-compute[76391]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 15 23:36:33 user nova-compute[76391]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 15 23:36:33 user nova-compute[76391]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 15 23:36:33 user nova-compute[76391]:     return putils.execute(on_execute=on_execute,
Nov 15 23:36:33 user nova-compute[76391]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 15 23:36:33 user nova-compute[76391]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 15 23:36:33 user nova-compute[76391]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 23:36:33 user nova-compute[76391]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 23:36:33 user nova-compute[76391]: Exit code: 21
Nov 15 23:36:33 user nova-compute[76391]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 23:36:33 user nova-compute[76391]: Stderr: ''
Nov 15 23:36:33 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea002ae-f03a-4ed1-b700-7d450a4e8eb2]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 23:36:33 user nova-compute[76391]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 23:36:33 user nova-compute[76391]: Exit code: 21
Nov 15 23:36:33 user nova-compute[76391]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 23:36:33 user nova-compute[76391]: Stderr: ''
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 15 23:36:33 user nova-compute[76391]: ERROR os_brick.initiator.connectors.iscsi 
Nov 15 23:36:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=76391) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] <== disconnect_volume: return (33ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:36:33 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Deleting instance files /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de_del
Nov 15 23:36:33 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Deletion of /opt/stack/data/nova/instances/1b78215b-26a1-47f5-8f9c-2e9f25b5f0de_del complete
Nov 15 23:36:33 user nova-compute[76391]: INFO nova.compute.manager [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 23:36:33 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:36:33 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:36:34 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:34 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-16db045f-4f8c-4721-871c-c7a2df8769d8 req-f4ccd71e-9b2e-4bac-b4ae-ba4b3687e82d service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-16db045f-4f8c-4721-871c-c7a2df8769d8 req-f4ccd71e-9b2e-4bac-b4ae-ba4b3687e82d service nova] Acquiring lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-16db045f-4f8c-4721-871c-c7a2df8769d8 req-f4ccd71e-9b2e-4bac-b4ae-ba4b3687e82d service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-16db045f-4f8c-4721-871c-c7a2df8769d8 req-f4ccd71e-9b2e-4bac-b4ae-ba4b3687e82d service nova] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:34 user nova-compute[76391]: DEBUG nova.compute.manager [req-16db045f-4f8c-4721-871c-c7a2df8769d8 req-f4ccd71e-9b2e-4bac-b4ae-ba4b3687e82d service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] No waiting events found dispatching network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:36:34 user nova-compute[76391]: WARNING nova.compute.manager [req-16db045f-4f8c-4721-871c-c7a2df8769d8 req-f4ccd71e-9b2e-4bac-b4ae-ba4b3687e82d service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received unexpected event network-vif-plugged-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab for instance with vm_state active and task_state deleting.
Nov 15 23:36:34 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:36:34 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Took 1.54 seconds to deallocate network for instance.
Nov 15 23:36:35 user nova-compute[76391]: WARNING nova.volume.cinder [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Attachment 52f9c393-11cc-4104-a490-bb0965a38af5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 52f9c393-11cc-4104-a490-bb0965a38af5. (HTTP 404) (Request-ID: req-ef47664e-ce11-40a5-9a66-b1c4d5b39a04)
Nov 15 23:36:35 user nova-compute[76391]: INFO nova.compute.manager [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 23:36:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:35 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:36:35 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:36:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:35 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Deleted allocations for instance 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de
Nov 15 23:36:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-52ebfbe1-35a0-4913-9fdf-fa8513278a2d tempest-VolumesSnapshotTestJSON-2045009250 tempest-VolumesSnapshotTestJSON-2045009250-project-member] Lock "1b78215b-26a1-47f5-8f9c-2e9f25b5f0de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.143s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:36:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:36 user nova-compute[76391]: DEBUG nova.compute.manager [req-af631355-4b1e-401b-a352-c2791d10077b req-d214a774-4d36-4611-9a6d-c6bcc0ac4232 service nova] [instance: 1b78215b-26a1-47f5-8f9c-2e9f25b5f0de] Received event network-vif-deleted-cceae0d7-e705-4ea4-a3a3-7f0bea2c84ab {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:44 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:36:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:36:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:36:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:54 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:36:54 user nova-compute[76391]: INFO nova.compute.claims [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Claim successful on node user
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.network.neutron [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:36:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.policy [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df069f99697e4424ac6c833251e9c47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f84553fb9741ee9ce5b74fa602b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:36:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Creating image(s)
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "/opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "/opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "/opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.202s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.200s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk 1073741824" returned: 0 in 0.067s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Successfully created port: b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.199s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Cannot resize image /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Ensure instance console log exists: /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Successfully updated port: b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquired lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-changed-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Refreshing instance network info cache due to event network-changed-b24fb092-3bae-437b-83e0-e22811d79ecd. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] Acquiring lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:36:56 user nova-compute[76391]: DEBUG nova.network.neutron [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.neutron [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Releasing lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Instance network_info: |[{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] Acquired lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Refreshing network info cache for port b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Start _get_guest_xml network_info=[{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:36:57 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:36:57 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1790628828',display_name='tempest-TestStampPattern-server-1790628828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1790628828',id=43,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDDSQ6k1cWwyS4WEd+yxAmvqQBEiExgn9f0DCEC8t6J855pUVXshZfGp1Bp7GX0xD5JJvzuJe44aIByWAyKotYhrTJuqO0XXhT5W+g+6AFBTdITap7Mbj/L0/6KVkJDFQ==',key_name='tempest-TestStampPattern-1250583077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14f84553fb9741ee9ce5b74fa602b637',ramdisk_id='',reservation_id='r-ft64vkel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1891858582',owner_user_name='tempest-TestStampPattern-1891858582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:36:55Z,user_data=None,user_id='df069f99697e4424ac6c833251e9c47c',uuid=e482ec5d-8630-4d09-9100-aa9ac345ecb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converting VIF {"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:bd:b1,bridge_name='br-int',has_traffic_filtering=True,id=b24fb092-3bae-437b-83e0-e22811d79ecd,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24fb092-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.objects.instance [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'pci_devices' on Instance uuid e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:36:57 user nova-compute[76391]:   <uuid>e482ec5d-8630-4d09-9100-aa9ac345ecb3</uuid>
Nov 15 23:36:57 user nova-compute[76391]:   <name>instance-0000002b</name>
Nov 15 23:36:57 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:36:57 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:36:57 user nova-compute[76391]:   <metadata>
Nov 15 23:36:57 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:36:57 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:36:57 user nova-compute[76391]:       <nova:name>tempest-TestStampPattern-server-1790628828</nova:name>
Nov 15 23:36:57 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:36:57</nova:creationTime>
Nov 15 23:36:57 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:36:57 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:36:57 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:36:57 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:36:57 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:36:57 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:36:57 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:36:57 user nova-compute[76391]:       <nova:owner>
Nov 15 23:36:57 user nova-compute[76391]:         <nova:user uuid="df069f99697e4424ac6c833251e9c47c">tempest-TestStampPattern-1891858582-project-member</nova:user>
Nov 15 23:36:57 user nova-compute[76391]:         <nova:project uuid="14f84553fb9741ee9ce5b74fa602b637">tempest-TestStampPattern-1891858582</nova:project>
Nov 15 23:36:57 user nova-compute[76391]:       </nova:owner>
Nov 15 23:36:57 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:36:57 user nova-compute[76391]:       <nova:ports>
Nov 15 23:36:57 user nova-compute[76391]:         <nova:port uuid="b24fb092-3bae-437b-83e0-e22811d79ecd">
Nov 15 23:36:57 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 23:36:57 user nova-compute[76391]:         </nova:port>
Nov 15 23:36:57 user nova-compute[76391]:       </nova:ports>
Nov 15 23:36:57 user nova-compute[76391]:     </nova:instance>
Nov 15 23:36:57 user nova-compute[76391]:   </metadata>
Nov 15 23:36:57 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:36:57 user nova-compute[76391]:     <system>
Nov 15 23:36:57 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:36:57 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:36:57 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:36:57 user nova-compute[76391]:       <entry name="serial">e482ec5d-8630-4d09-9100-aa9ac345ecb3</entry>
Nov 15 23:36:57 user nova-compute[76391]:       <entry name="uuid">e482ec5d-8630-4d09-9100-aa9ac345ecb3</entry>
Nov 15 23:36:57 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:36:57 user nova-compute[76391]:     </system>
Nov 15 23:36:57 user nova-compute[76391]:   </sysinfo>
Nov 15 23:36:57 user nova-compute[76391]:   <os>
Nov 15 23:36:57 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:36:57 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:36:57 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:36:57 user nova-compute[76391]:   </os>
Nov 15 23:36:57 user nova-compute[76391]:   <features>
Nov 15 23:36:57 user nova-compute[76391]:     <acpi/>
Nov 15 23:36:57 user nova-compute[76391]:     <apic/>
Nov 15 23:36:57 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:36:57 user nova-compute[76391]:   </features>
Nov 15 23:36:57 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:36:57 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:36:57 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:36:57 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:36:57 user nova-compute[76391]:   </clock>
Nov 15 23:36:57 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:36:57 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:36:57 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:36:57 user nova-compute[76391]:   </cpu>
Nov 15 23:36:57 user nova-compute[76391]:   <devices>
Nov 15 23:36:57 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:36:57 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:36:57 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk"/>
Nov 15 23:36:57 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:36:57 user nova-compute[76391]:     </disk>
Nov 15 23:36:57 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:36:57 user nova-compute[76391]:       <mac address="fa:16:3e:39:bd:b1"/>
Nov 15 23:36:57 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:36:57 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:36:57 user nova-compute[76391]:       <target dev="tapb24fb092-3b"/>
Nov 15 23:36:57 user nova-compute[76391]:     </interface>
Nov 15 23:36:57 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:36:57 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/console.log" append="off"/>
Nov 15 23:36:57 user nova-compute[76391]:     </serial>
Nov 15 23:36:57 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:36:57 user nova-compute[76391]:     <video>
Nov 15 23:36:57 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:36:57 user nova-compute[76391]:     </video>
Nov 15 23:36:57 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:36:57 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:36:57 user nova-compute[76391]:     </rng>
Nov 15 23:36:57 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:36:57 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:36:57 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:36:57 user nova-compute[76391]:     </memballoon>
Nov 15 23:36:57 user nova-compute[76391]:   </devices>
Nov 15 23:36:57 user nova-compute[76391]: </domain>
Nov 15 23:36:57 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1790628828',display_name='tempest-TestStampPattern-server-1790628828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1790628828',id=43,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDDSQ6k1cWwyS4WEd+yxAmvqQBEiExgn9f0DCEC8t6J855pUVXshZfGp1Bp7GX0xD5JJvzuJe44aIByWAyKotYhrTJuqO0XXhT5W+g+6AFBTdITap7Mbj/L0/6KVkJDFQ==',key_name='tempest-TestStampPattern-1250583077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14f84553fb9741ee9ce5b74fa602b637',ramdisk_id='',reservation_id='r-ft64vkel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1891858582',owner_user_name='tempest-TestStampPattern-1891858582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:36:55Z,user_data=None,user_id='df069f99697e4424ac6c833251e9c47c',uuid=e482ec5d-8630-4d09-9100-aa9ac345ecb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converting VIF {"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:bd:b1,bridge_name='br-int',has_traffic_filtering=True,id=b24fb092-3bae-437b-83e0-e22811d79ecd,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24fb092-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG os_vif [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:bd:b1,bridge_name='br-int',has_traffic_filtering=True,id=b24fb092-3bae-437b-83e0-e22811d79ecd,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24fb092-3b') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17d895e7-1bbf-5c4e-8902-13cf829090f1', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb24fb092-3b, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb24fb092-3b, col_values=(('qos', UUID('99228dc4-2e1f-4abc-824f-7c05b24beefc')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb24fb092-3b, col_values=(('external_ids', {'iface-id': 'b24fb092-3bae-437b-83e0-e22811d79ecd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:bd:b1', 'vm-uuid': 'e482ec5d-8630-4d09-9100-aa9ac345ecb3'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:57 user nova-compute[76391]: INFO os_vif [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:bd:b1,bridge_name='br-int',has_traffic_filtering=True,id=b24fb092-3bae-437b-83e0-e22811d79ecd,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24fb092-3b')
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No VIF found with MAC fa:16:3e:39:bd:b1, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updated VIF entry in instance network info cache for port b24fb092-3bae-437b-83e0-e22811d79ecd. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:36:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d3e478fa-3435-4a62-bd25-dc97ef2fd2c3 req-92e49ccb-751d-4a9e-8c95-ed6ff4a2852b service nova] Releasing lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:36:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-72679b00-8421-451b-91ac-31df7761dd62 req-4f8a05e5-45ca-425a-bfaf-5dcd467c98e1 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-72679b00-8421-451b-91ac-31df7761dd62 req-4f8a05e5-45ca-425a-bfaf-5dcd467c98e1 service nova] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-72679b00-8421-451b-91ac-31df7761dd62 req-4f8a05e5-45ca-425a-bfaf-5dcd467c98e1 service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-72679b00-8421-451b-91ac-31df7761dd62 req-4f8a05e5-45ca-425a-bfaf-5dcd467c98e1 service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-72679b00-8421-451b-91ac-31df7761dd62 req-4f8a05e5-45ca-425a-bfaf-5dcd467c98e1 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] No waiting events found dispatching network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:36:59 user nova-compute[76391]: WARNING nova.compute.manager [req-72679b00-8421-451b-91ac-31df7761dd62 req-4f8a05e5-45ca-425a-bfaf-5dcd467c98e1 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received unexpected event network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd for instance with vm_state building and task_state spawning.
Nov 15 23:36:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:36:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:37:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Instance spawned successfully.
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:01 user nova-compute[76391]: INFO nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 15 23:37:01 user nova-compute[76391]: DEBUG nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:37:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-0d49eb9b-d520-4894-84c3-d17b5adbb108 req-13b0224f-769f-48d0-a61f-1559dd3ac84e service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:37:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0d49eb9b-d520-4894-84c3-d17b5adbb108 req-13b0224f-769f-48d0-a61f-1559dd3ac84e service nova] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0d49eb9b-d520-4894-84c3-d17b5adbb108 req-13b0224f-769f-48d0-a61f-1559dd3ac84e service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0d49eb9b-d520-4894-84c3-d17b5adbb108 req-13b0224f-769f-48d0-a61f-1559dd3ac84e service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-0d49eb9b-d520-4894-84c3-d17b5adbb108 req-13b0224f-769f-48d0-a61f-1559dd3ac84e service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] No waiting events found dispatching network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:37:01 user nova-compute[76391]: WARNING nova.compute.manager [req-0d49eb9b-d520-4894-84c3-d17b5adbb108 req-13b0224f-769f-48d0-a61f-1559dd3ac84e service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received unexpected event network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd for instance with vm_state building and task_state spawning.
Nov 15 23:37:01 user nova-compute[76391]: INFO nova.compute.manager [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Took 6.25 seconds to build instance.
Nov 15 23:37:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-906ecac1-0b92-46e9-bed1-2ccb10b0a53f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:37:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:26 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:37:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:37:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=25.121509552001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:37:27 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:29 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:37:29 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:37:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:34 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:37:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:36 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:37:36 user nova-compute[76391]: INFO nova.compute.claims [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Claim successful on node user
Nov 15 23:37:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:37:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.policy [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '021a4c49075349408c8453ea4caef8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a89d6c211b64177ac826eafc074046e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:37:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Creating image(s)
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "/opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "/opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.199s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk 1073741824" returned: 0 in 0.051s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Successfully created port: cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.200s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Cannot resize image /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Ensure instance console log exists: /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Successfully updated port: cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquired lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-changed-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.compute.manager [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Refreshing instance network info cache due to event network-changed-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] Acquiring lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:37:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating instance_info_cache with network_info: [{"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Releasing lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Instance network_info: |[{"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] Acquired lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Refreshing network info cache for port cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Start _get_guest_xml network_info=[{"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:37:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:37:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:37:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1449916738',display_name='tempest-SnapshotDataIntegrityTests-server-1449916738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1449916738',id=44,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk340Dle+QdOpifZuCA2qGaw5hyan3DHw8f9CmT9xOl34D/oX3lsBrX+fCp6SOYIG0W97xI4YCSkDH3jEnCSwFfA2GoKkb1IAmlxeGVE4J2VIAEPOxDNGaMgFyfQas7gg==',key_name='tempest-keypair-1896054919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a89d6c211b64177ac826eafc074046e',ramdisk_id='',reservation_id='r-7vrr44cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1887883826',owner_user_name='tempest-SnapshotDataIntegrityTests-1887883826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='021a4c49075349408c8453ea4caef8cc',uuid=6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Converting VIF {"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:a2,bridge_name='br-int',has_traffic_filtering=True,id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1,network=Network(db298d76-06d0-47c2-9b64-87949505d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1e4d26-0a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:37:39 user nova-compute[76391]:   <uuid>6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354</uuid>
Nov 15 23:37:39 user nova-compute[76391]:   <name>instance-0000002c</name>
Nov 15 23:37:39 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:37:39 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:37:39 user nova-compute[76391]:   <metadata>
Nov 15 23:37:39 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:37:39 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:37:39 user nova-compute[76391]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1449916738</nova:name>
Nov 15 23:37:39 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:37:39</nova:creationTime>
Nov 15 23:37:39 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:37:39 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:37:39 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:37:39 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:37:39 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:37:39 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:37:39 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:37:39 user nova-compute[76391]:       <nova:owner>
Nov 15 23:37:39 user nova-compute[76391]:         <nova:user uuid="021a4c49075349408c8453ea4caef8cc">tempest-SnapshotDataIntegrityTests-1887883826-project-member</nova:user>
Nov 15 23:37:39 user nova-compute[76391]:         <nova:project uuid="9a89d6c211b64177ac826eafc074046e">tempest-SnapshotDataIntegrityTests-1887883826</nova:project>
Nov 15 23:37:39 user nova-compute[76391]:       </nova:owner>
Nov 15 23:37:39 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:37:39 user nova-compute[76391]:       <nova:ports>
Nov 15 23:37:39 user nova-compute[76391]:         <nova:port uuid="cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1">
Nov 15 23:37:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:37:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:37:39 user nova-compute[76391]:       </nova:ports>
Nov 15 23:37:39 user nova-compute[76391]:     </nova:instance>
Nov 15 23:37:39 user nova-compute[76391]:   </metadata>
Nov 15 23:37:39 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:37:39 user nova-compute[76391]:     <system>
Nov 15 23:37:39 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:37:39 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:37:39 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:37:39 user nova-compute[76391]:       <entry name="serial">6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354</entry>
Nov 15 23:37:39 user nova-compute[76391]:       <entry name="uuid">6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354</entry>
Nov 15 23:37:39 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:37:39 user nova-compute[76391]:     </system>
Nov 15 23:37:39 user nova-compute[76391]:   </sysinfo>
Nov 15 23:37:39 user nova-compute[76391]:   <os>
Nov 15 23:37:39 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:37:39 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:37:39 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:37:39 user nova-compute[76391]:   </os>
Nov 15 23:37:39 user nova-compute[76391]:   <features>
Nov 15 23:37:39 user nova-compute[76391]:     <acpi/>
Nov 15 23:37:39 user nova-compute[76391]:     <apic/>
Nov 15 23:37:39 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:37:39 user nova-compute[76391]:   </features>
Nov 15 23:37:39 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:37:39 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:37:39 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:37:39 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:37:39 user nova-compute[76391]:   </clock>
Nov 15 23:37:39 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:37:39 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:37:39 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:37:39 user nova-compute[76391]:   </cpu>
Nov 15 23:37:39 user nova-compute[76391]:   <devices>
Nov 15 23:37:39 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:37:39 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:37:39 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk"/>
Nov 15 23:37:39 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:37:39 user nova-compute[76391]:     </disk>
Nov 15 23:37:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:37:39 user nova-compute[76391]:       <mac address="fa:16:3e:9c:54:a2"/>
Nov 15 23:37:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:37:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:37:39 user nova-compute[76391]:       <target dev="tapcd1e4d26-0a"/>
Nov 15 23:37:39 user nova-compute[76391]:     </interface>
Nov 15 23:37:39 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:37:39 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/console.log" append="off"/>
Nov 15 23:37:39 user nova-compute[76391]:     </serial>
Nov 15 23:37:39 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:37:39 user nova-compute[76391]:     <video>
Nov 15 23:37:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:37:39 user nova-compute[76391]:     </video>
Nov 15 23:37:39 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:37:39 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:37:39 user nova-compute[76391]:     </rng>
Nov 15 23:37:39 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:37:39 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:37:39 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:37:39 user nova-compute[76391]:     </memballoon>
Nov 15 23:37:39 user nova-compute[76391]:   </devices>
Nov 15 23:37:39 user nova-compute[76391]: </domain>
Nov 15 23:37:39 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:37:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1449916738',display_name='tempest-SnapshotDataIntegrityTests-server-1449916738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1449916738',id=44,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk340Dle+QdOpifZuCA2qGaw5hyan3DHw8f9CmT9xOl34D/oX3lsBrX+fCp6SOYIG0W97xI4YCSkDH3jEnCSwFfA2GoKkb1IAmlxeGVE4J2VIAEPOxDNGaMgFyfQas7gg==',key_name='tempest-keypair-1896054919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a89d6c211b64177ac826eafc074046e',ramdisk_id='',reservation_id='r-7vrr44cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1887883826',owner_user_name='tempest-SnapshotDataIntegrityTests-1887883826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='021a4c49075349408c8453ea4caef8cc',uuid=6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Converting VIF {"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:a2,bridge_name='br-int',has_traffic_filtering=True,id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1,network=Network(db298d76-06d0-47c2-9b64-87949505d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1e4d26-0a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG os_vif [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:a2,bridge_name='br-int',has_traffic_filtering=True,id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1,network=Network(db298d76-06d0-47c2-9b64-87949505d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1e4d26-0a') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '303cf60d-bf60-545c-a57d-0c878158e75b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd1e4d26-0a, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd1e4d26-0a, col_values=(('qos', UUID('e52b7b61-c9ce-44ed-9820-3d9d87ff75fd')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd1e4d26-0a, col_values=(('external_ids', {'iface-id': 'cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:54:a2', 'vm-uuid': '6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:39 user nova-compute[76391]: INFO os_vif [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:a2,bridge_name='br-int',has_traffic_filtering=True,id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1,network=Network(db298d76-06d0-47c2-9b64-87949505d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1e4d26-0a')
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:37:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No VIF found with MAC fa:16:3e:9c:54:a2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:37:40 user nova-compute[76391]: DEBUG nova.network.neutron [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updated VIF entry in instance network info cache for port cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:37:40 user nova-compute[76391]: DEBUG nova.network.neutron [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating instance_info_cache with network_info: [{"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:37:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-63381573-8aae-4bc0-9cac-00a479c50f1d req-6f639642-e183-4a9e-ac0b-4c932507fad0 service nova] Releasing lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:37:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-899beb03-597f-4d0d-af73-aea43e26d533 req-14cdda2e-6a9c-4c9a-981e-44325ccb6eee service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-899beb03-597f-4d0d-af73-aea43e26d533 req-14cdda2e-6a9c-4c9a-981e-44325ccb6eee service nova] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-899beb03-597f-4d0d-af73-aea43e26d533 req-14cdda2e-6a9c-4c9a-981e-44325ccb6eee service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-899beb03-597f-4d0d-af73-aea43e26d533 req-14cdda2e-6a9c-4c9a-981e-44325ccb6eee service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-899beb03-597f-4d0d-af73-aea43e26d533 req-14cdda2e-6a9c-4c9a-981e-44325ccb6eee service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] No waiting events found dispatching network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:37:41 user nova-compute[76391]: WARNING nova.compute.manager [req-899beb03-597f-4d0d-af73-aea43e26d533 req-14cdda2e-6a9c-4c9a-981e-44325ccb6eee service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received unexpected event network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 for instance with vm_state building and task_state spawning.
Nov 15 23:37:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:37:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Instance spawned successfully.
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-0543b230-5b91-42d0-a770-acc613c73f4e req-4501cf9d-b43f-4096-bdcc-fd32e6d17c50 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0543b230-5b91-42d0-a770-acc613c73f4e req-4501cf9d-b43f-4096-bdcc-fd32e6d17c50 service nova] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0543b230-5b91-42d0-a770-acc613c73f4e req-4501cf9d-b43f-4096-bdcc-fd32e6d17c50 service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0543b230-5b91-42d0-a770-acc613c73f4e req-4501cf9d-b43f-4096-bdcc-fd32e6d17c50 service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-0543b230-5b91-42d0-a770-acc613c73f4e req-4501cf9d-b43f-4096-bdcc-fd32e6d17c50 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] No waiting events found dispatching network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:37:43 user nova-compute[76391]: WARNING nova.compute.manager [req-0543b230-5b91-42d0-a770-acc613c73f4e req-4501cf9d-b43f-4096-bdcc-fd32e6d17c50 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received unexpected event network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 for instance with vm_state building and task_state spawning.
Nov 15 23:37:43 user nova-compute[76391]: INFO nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 15 23:37:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:37:43 user nova-compute[76391]: INFO nova.compute.manager [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Took 6.63 seconds to build instance.
Nov 15 23:37:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-79d2e162-5066-4d0a-b15c-2919958b116d tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.795s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:37:51 user nova-compute[76391]: INFO nova.compute.claims [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Claim successful on node user
Nov 15 23:37:51 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:37:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:37:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:37:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:37:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:37:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:37:52 user nova-compute[76391]: DEBUG nova.policy [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8b2b277f69f480f8a2c102a46792247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b3dc7e25d24f309b8c4bb7be5ad0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:37:52 user nova-compute[76391]: INFO nova.virt.block_device [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Booting with volume snapshot f77b9d07-d398-4416-bc2c-17190b96a07f at /dev/vda
Nov 15 23:37:52 user nova-compute[76391]: DEBUG nova.network.neutron [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Successfully created port: 84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Successfully updated port: 84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "refresh_cache-9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquired lock "refresh_cache-9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received event network-changed-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Refreshing instance network info cache due to event network-changed-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] Acquiring lock "refresh_cache-9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.network.neutron [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Updating instance_info_cache with network_info: [{"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Releasing lock "refresh_cache-9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Instance network_info: |[{"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] Acquired lock "refresh_cache-9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:37:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Refreshing network info cache for port 84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:37:54 user nova-compute[76391]: DEBUG nova.network.neutron [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Updated VIF entry in instance network info cache for port 84dbc480-51ec-4ee0-94c3-dae13cdc4bdc. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:37:54 user nova-compute[76391]: DEBUG nova.network.neutron [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Updating instance_info_cache with network_info: [{"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:37:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d56a5952-e124-419a-888e-7c8b88e0c90a req-f84ca4b6-6c36-47ea-9d80-83a7b636d558 service nova] Releasing lock "refresh_cache-9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:37:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:37:57 user nova-compute[76391]: DEBUG os_brick.utils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:37:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:57 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e205552f-9d4b-400c-9bdb-5843ce5df202]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:37:57 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bede8bed-6240-4378-bfc1-52141162fdbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c324c6-2689-42c3-a262-9a6c352a9d21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7dd1a7-bef6-4cf1-a795-44e122a7e531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:37:58 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:37:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be57380-50c7-4ff7-a67f-a1bfdcccdebf]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG os_brick.utils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:37:58 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Updating existing volume attachment record: dc0427f4-ac43-491a-99a7-2e02a021bbdb {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:37:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquired lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'info_cache' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Releasing lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:38:04 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance destroyed successfully.
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'resources' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG os_vif [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b8989d-62, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a200f19-83ef-45c3-b66a-1e667f15cc77) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:38:04 user nova-compute[76391]: INFO os_vif [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62')
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Start _get_guest_xml network_info=[{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'numa_topology' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:38:04 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:38:04 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'pci_devices' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.objects.base [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:38:04 user nova-compute[76391]:   <uuid>6be3d794-c793-4da2-bfa2-8547215014ca</uuid>
Nov 15 23:38:04 user nova-compute[76391]:   <name>instance-00000027</name>
Nov 15 23:38:04 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:38:04 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:38:04 user nova-compute[76391]:   <metadata>
Nov 15 23:38:04 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:38:04 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:38:04 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeTestJSON-server-1699613562</nova:name>
Nov 15 23:38:04 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:38:04</nova:creationTime>
Nov 15 23:38:04 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:38:04 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:38:04 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:38:04 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:38:04 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:38:04 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:38:04 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:38:04 user nova-compute[76391]:       <nova:owner>
Nov 15 23:38:04 user nova-compute[76391]:         <nova:user uuid="efa0b862a4e54967ba27a6cc88bb5496">tempest-AttachVolumeTestJSON-1495860226-project-member</nova:user>
Nov 15 23:38:04 user nova-compute[76391]:         <nova:project uuid="28f76509cb8a4588a018268eee3eb14a">tempest-AttachVolumeTestJSON-1495860226</nova:project>
Nov 15 23:38:04 user nova-compute[76391]:       </nova:owner>
Nov 15 23:38:04 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:38:04 user nova-compute[76391]:       <nova:ports>
Nov 15 23:38:04 user nova-compute[76391]:         <nova:port uuid="e9b8989d-623b-41ab-afe4-80edc71bb67c">
Nov 15 23:38:04 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 23:38:04 user nova-compute[76391]:         </nova:port>
Nov 15 23:38:04 user nova-compute[76391]:       </nova:ports>
Nov 15 23:38:04 user nova-compute[76391]:     </nova:instance>
Nov 15 23:38:04 user nova-compute[76391]:   </metadata>
Nov 15 23:38:04 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:38:04 user nova-compute[76391]:     <system>
Nov 15 23:38:04 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:38:04 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:38:04 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:38:04 user nova-compute[76391]:       <entry name="serial">6be3d794-c793-4da2-bfa2-8547215014ca</entry>
Nov 15 23:38:04 user nova-compute[76391]:       <entry name="uuid">6be3d794-c793-4da2-bfa2-8547215014ca</entry>
Nov 15 23:38:04 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:38:04 user nova-compute[76391]:     </system>
Nov 15 23:38:04 user nova-compute[76391]:   </sysinfo>
Nov 15 23:38:04 user nova-compute[76391]:   <os>
Nov 15 23:38:04 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:38:04 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:38:04 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:38:04 user nova-compute[76391]:   </os>
Nov 15 23:38:04 user nova-compute[76391]:   <features>
Nov 15 23:38:04 user nova-compute[76391]:     <acpi/>
Nov 15 23:38:04 user nova-compute[76391]:     <apic/>
Nov 15 23:38:04 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:38:04 user nova-compute[76391]:   </features>
Nov 15 23:38:04 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:38:04 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:38:04 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:38:04 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:38:04 user nova-compute[76391]:   </clock>
Nov 15 23:38:04 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:38:04 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:38:04 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:38:04 user nova-compute[76391]:   </cpu>
Nov 15 23:38:04 user nova-compute[76391]:   <devices>
Nov 15 23:38:04 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:38:04 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:38:04 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk"/>
Nov 15 23:38:04 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:38:04 user nova-compute[76391]:     </disk>
Nov 15 23:38:04 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:38:04 user nova-compute[76391]:       <mac address="fa:16:3e:ec:71:f6"/>
Nov 15 23:38:04 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:38:04 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:38:04 user nova-compute[76391]:       <target dev="tape9b8989d-62"/>
Nov 15 23:38:04 user nova-compute[76391]:     </interface>
Nov 15 23:38:04 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:38:04 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/console.log" append="off"/>
Nov 15 23:38:04 user nova-compute[76391]:     </serial>
Nov 15 23:38:04 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:38:04 user nova-compute[76391]:     <video>
Nov 15 23:38:04 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:38:04 user nova-compute[76391]:     </video>
Nov 15 23:38:04 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:38:04 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:38:04 user nova-compute[76391]:     </rng>
Nov 15 23:38:04 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:38:04 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:38:04 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:38:04 user nova-compute[76391]:     </memballoon>
Nov 15 23:38:04 user nova-compute[76391]:   </devices>
Nov 15 23:38:04 user nova-compute[76391]: </domain>
Nov 15 23:38:04 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:38:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.objects.base [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Cannot resize image /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'migration_context' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.objects.base [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Object Instance<6be3d794-c793-4da2-bfa2-8547215014ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG os_vif [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dddcd68-4d91-56a8-b254-ab6f5f826b2b', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b8989d-62, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9b8989d-62, col_values=(('qos', UUID('0b8fd318-a8f7-425e-be1f-9c792e1b945c')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9b8989d-62, col_values=(('external_ids', {'iface-id': 'e9b8989d-623b-41ab-afe4-80edc71bb67c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:71:f6', 'vm-uuid': '6be3d794-c793-4da2-bfa2-8547215014ca'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:05 user nova-compute[76391]: INFO os_vif [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62')
Nov 15 23:38:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-beab948a-b325-4beb-8e07-556ae2103d4b req-7d5c676d-48e6-4576-b249-21e4b903b6f0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-beab948a-b325-4beb-8e07-556ae2103d4b req-7d5c676d-48e6-4576-b249-21e4b903b6f0 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-beab948a-b325-4beb-8e07-556ae2103d4b req-7d5c676d-48e6-4576-b249-21e4b903b6f0 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-beab948a-b325-4beb-8e07-556ae2103d4b req-7d5c676d-48e6-4576-b249-21e4b903b6f0 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG nova.compute.manager [req-beab948a-b325-4beb-8e07-556ae2103d4b req-7d5c676d-48e6-4576-b249-21e4b903b6f0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:38:07 user nova-compute[76391]: WARNING nova.compute.manager [req-beab948a-b325-4beb-8e07-556ae2103d4b req-7d5c676d-48e6-4576-b249-21e4b903b6f0 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state stopped and task_state powering-on.
Nov 15 23:38:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:38:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Creating image(s)
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Ensure instance console log exists: /opt/stack/data/nova/instances/9dacd7d8-1af2-4a0d-bbe1-8d1d74581582/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Start _get_guest_xml network_info=[{"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCWJtjSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9dacd7d8-1af2-4a0d-bbe1-8d1d74581582', 'attached_at': '', 'detached_at': '', 'volume_id': '1e9019d5-9326-4b7c-bea1-44fc36e3ea0d', 'serial': '1e9019d5-9326-4b7c-bea1-44fc36e3ea0d'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'dc0427f4-ac43-491a-99a7-2e02a021bbdb', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:38:08 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:38:08 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCWJtjSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:38:08 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:38:08 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:38:08 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab9d89-ad23-4f3d-ad96-b1e133fbeeff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:38:08 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d902a-3066-4803-a113-167a7168e488]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d] added
Nov 15 23:38:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c49b68-4cfb-4e0a-ae88-195ea37a4efd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b4f30-740f-4efe-a22e-4c0edd5aba2e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCWJtjSO {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCWJtjSO" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4403bf-2a9c-4e6c-8e6e-304e31aed5d6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yCWJtjSO'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24924b5-4dcc-4aa2-9776-504ebfb2aac0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1399079-f151-4c1d-9d94-631e6147a117]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:38:08 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:38:08 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:38:08 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:38:08 user nova-compute[76391]: 
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40619e89-5e82-4653-980e-4cf8d16c3a43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260]
Nov 15 23:38:08 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260] successful.
Nov 15 23:38:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e454c-2d46-4f8b-9160-5b424fc1d168]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[654af6e9-5405-430e-b639-3626fa222cf5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:38:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:38:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6574e9-9b56-41ce-a951-1b7162872533]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:38:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCWJtjSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0e5bf59-8f96-47c0-a08f-e348299608be req-5c1ef787-d5eb-4bc1-b070-3c0fd74355f2 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0e5bf59-8f96-47c0-a08f-e348299608be req-5c1ef787-d5eb-4bc1-b070-3c0fd74355f2 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0e5bf59-8f96-47c0-a08f-e348299608be req-5c1ef787-d5eb-4bc1-b070-3c0fd74355f2 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0e5bf59-8f96-47c0-a08f-e348299608be req-5c1ef787-d5eb-4bc1-b070-3c0fd74355f2 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0e5bf59-8f96-47c0-a08f-e348299608be req-5c1ef787-d5eb-4bc1-b070-3c0fd74355f2 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:38:09 user nova-compute[76391]: WARNING nova.compute.manager [req-e0e5bf59-8f96-47c0-a08f-e348299608be req-5c1ef787-d5eb-4bc1-b070-3c0fd74355f2 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state stopped and task_state powering-on.
Nov 15 23:38:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26539363534356539', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539363534356539', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:38:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance rebooted successfully.
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a1d5234b-fe24-41d1-8738-8ecbec049918 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1302705859',display_name='tempest-TestVolumeBootPattern-server-1302705859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1302705859',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-zt77vu9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:37:52Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=9dacd7d8-1af2-4a0d-bbe1-8d1d74581582,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:14:f7,bridge_name='br-int',has_traffic_filtering=True,id=84dbc480-51ec-4ee0-94c3-dae13cdc4bdc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dbc480-51') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.objects.instance [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:38:09 user nova-compute[76391]:   <uuid>9dacd7d8-1af2-4a0d-bbe1-8d1d74581582</uuid>
Nov 15 23:38:09 user nova-compute[76391]:   <name>instance-0000002d</name>
Nov 15 23:38:09 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:38:09 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:38:09 user nova-compute[76391]:   <metadata>
Nov 15 23:38:09 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:38:09 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:38:09 user nova-compute[76391]:       <nova:name>tempest-TestVolumeBootPattern-server-1302705859</nova:name>
Nov 15 23:38:09 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:38:08</nova:creationTime>
Nov 15 23:38:09 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:38:09 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:38:09 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:38:09 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:38:09 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:38:09 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:38:09 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:38:09 user nova-compute[76391]:       <nova:owner>
Nov 15 23:38:09 user nova-compute[76391]:         <nova:user uuid="b8b2b277f69f480f8a2c102a46792247">tempest-TestVolumeBootPattern-1132666866-project-member</nova:user>
Nov 15 23:38:09 user nova-compute[76391]:         <nova:project uuid="93b3dc7e25d24f309b8c4bb7be5ad0f2">tempest-TestVolumeBootPattern-1132666866</nova:project>
Nov 15 23:38:09 user nova-compute[76391]:       </nova:owner>
Nov 15 23:38:09 user nova-compute[76391]:       <nova:ports>
Nov 15 23:38:09 user nova-compute[76391]:         <nova:port uuid="84dbc480-51ec-4ee0-94c3-dae13cdc4bdc">
Nov 15 23:38:09 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 23:38:09 user nova-compute[76391]:         </nova:port>
Nov 15 23:38:09 user nova-compute[76391]:       </nova:ports>
Nov 15 23:38:09 user nova-compute[76391]:     </nova:instance>
Nov 15 23:38:09 user nova-compute[76391]:   </metadata>
Nov 15 23:38:09 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:38:09 user nova-compute[76391]:     <system>
Nov 15 23:38:09 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:38:09 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:38:09 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:38:09 user nova-compute[76391]:       <entry name="serial">9dacd7d8-1af2-4a0d-bbe1-8d1d74581582</entry>
Nov 15 23:38:09 user nova-compute[76391]:       <entry name="uuid">9dacd7d8-1af2-4a0d-bbe1-8d1d74581582</entry>
Nov 15 23:38:09 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:38:09 user nova-compute[76391]:     </system>
Nov 15 23:38:09 user nova-compute[76391]:   </sysinfo>
Nov 15 23:38:09 user nova-compute[76391]:   <os>
Nov 15 23:38:09 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:38:09 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:38:09 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:38:09 user nova-compute[76391]:   </os>
Nov 15 23:38:09 user nova-compute[76391]:   <features>
Nov 15 23:38:09 user nova-compute[76391]:     <acpi/>
Nov 15 23:38:09 user nova-compute[76391]:     <apic/>
Nov 15 23:38:09 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:38:09 user nova-compute[76391]:   </features>
Nov 15 23:38:09 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:38:09 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:38:09 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:38:09 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:38:09 user nova-compute[76391]:   </clock>
Nov 15 23:38:09 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:38:09 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:38:09 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:38:09 user nova-compute[76391]:   </cpu>
Nov 15 23:38:09 user nova-compute[76391]:   <devices>
Nov 15 23:38:09 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:38:09 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:38:09 user nova-compute[76391]:       <source dev="/dev/sdb"/>
Nov 15 23:38:09 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:38:09 user nova-compute[76391]:       <serial>1e9019d5-9326-4b7c-bea1-44fc36e3ea0d</serial>
Nov 15 23:38:09 user nova-compute[76391]:     </disk>
Nov 15 23:38:09 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:38:09 user nova-compute[76391]:       <mac address="fa:16:3e:5b:14:f7"/>
Nov 15 23:38:09 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:38:09 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:38:09 user nova-compute[76391]:       <target dev="tap84dbc480-51"/>
Nov 15 23:38:09 user nova-compute[76391]:     </interface>
Nov 15 23:38:09 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:38:09 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/9dacd7d8-1af2-4a0d-bbe1-8d1d74581582/console.log" append="off"/>
Nov 15 23:38:09 user nova-compute[76391]:     </serial>
Nov 15 23:38:09 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:38:09 user nova-compute[76391]:     <video>
Nov 15 23:38:09 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:38:09 user nova-compute[76391]:     </video>
Nov 15 23:38:09 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:38:09 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:38:09 user nova-compute[76391]:     </rng>
Nov 15 23:38:09 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:38:09 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:38:09 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:38:09 user nova-compute[76391]:     </memballoon>
Nov 15 23:38:09 user nova-compute[76391]:   </devices>
Nov 15 23:38:09 user nova-compute[76391]: </domain>
Nov 15 23:38:09 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1302705859',display_name='tempest-TestVolumeBootPattern-server-1302705859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1302705859',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-zt77vu9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:37:52Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=9dacd7d8-1af2-4a0d-bbe1-8d1d74581582,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:14:f7,bridge_name='br-int',has_traffic_filtering=True,id=84dbc480-51ec-4ee0-94c3-dae13cdc4bdc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dbc480-51') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG os_vif [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:14:f7,bridge_name='br-int',has_traffic_filtering=True,id=84dbc480-51ec-4ee0-94c3-dae13cdc4bdc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dbc480-51') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c840907d-db29-53f6-80bf-9382570e3092', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84dbc480-51, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84dbc480-51, col_values=(('qos', UUID('35e47f76-f6d6-436b-abcb-742863d54708')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84dbc480-51, col_values=(('external_ids', {'iface-id': '84dbc480-51ec-4ee0-94c3-dae13cdc4bdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:14:f7', 'vm-uuid': '9dacd7d8-1af2-4a0d-bbe1-8d1d74581582'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:09 user nova-compute[76391]: INFO os_vif [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:14:f7,bridge_name='br-int',has_traffic_filtering=True,id=84dbc480-51ec-4ee0-94c3-dae13cdc4bdc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dbc480-51')
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:38:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No VIF found with MAC fa:16:3e:5b:14:f7, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:38:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-cbe08d1e-512d-414d-8e8e-8fdf2a137e09 req-8171b31f-b6e7-492c-9e66-786c168b0c19 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received event network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cbe08d1e-512d-414d-8e8e-8fdf2a137e09 req-8171b31f-b6e7-492c-9e66-786c168b0c19 service nova] Acquiring lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cbe08d1e-512d-414d-8e8e-8fdf2a137e09 req-8171b31f-b6e7-492c-9e66-786c168b0c19 service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cbe08d1e-512d-414d-8e8e-8fdf2a137e09 req-8171b31f-b6e7-492c-9e66-786c168b0c19 service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG nova.compute.manager [req-cbe08d1e-512d-414d-8e8e-8fdf2a137e09 req-8171b31f-b6e7-492c-9e66-786c168b0c19 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] No waiting events found dispatching network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:38:11 user nova-compute[76391]: WARNING nova.compute.manager [req-cbe08d1e-512d-414d-8e8e-8fdf2a137e09 req-8171b31f-b6e7-492c-9e66-786c168b0c19 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received unexpected event network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc for instance with vm_state building and task_state spawning.
Nov 15 23:38:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:38:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Instance spawned successfully.
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:38:13 user nova-compute[76391]: INFO nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:38:13 user nova-compute[76391]: INFO nova.compute.manager [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Took 21.80 seconds to build instance.
Nov 15 23:38:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-314a8987-12b2-41c7-b0b2-9ceb135c84ee tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.059s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8f7aee3-59e9-442b-800e-6e0fd0e9054e req-06f7d9c7-1c86-4cbd-91a3-00bc4f3fb529 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received event network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8f7aee3-59e9-442b-800e-6e0fd0e9054e req-06f7d9c7-1c86-4cbd-91a3-00bc4f3fb529 service nova] Acquiring lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8f7aee3-59e9-442b-800e-6e0fd0e9054e req-06f7d9c7-1c86-4cbd-91a3-00bc4f3fb529 service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-a8f7aee3-59e9-442b-800e-6e0fd0e9054e req-06f7d9c7-1c86-4cbd-91a3-00bc4f3fb529 service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:13 user nova-compute[76391]: DEBUG nova.compute.manager [req-a8f7aee3-59e9-442b-800e-6e0fd0e9054e req-06f7d9c7-1c86-4cbd-91a3-00bc4f3fb529 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] No waiting events found dispatching network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:38:13 user nova-compute[76391]: WARNING nova.compute.manager [req-a8f7aee3-59e9-442b-800e-6e0fd0e9054e req-06f7d9c7-1c86-4cbd-91a3-00bc4f3fb529 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received unexpected event network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc for instance with vm_state active and task_state None.
Nov 15 23:38:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:29 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:38:29 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8326MB free_disk=25.062381744384766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [{"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-6be3d794-c793-4da2-bfa2-8547215014ca" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:38:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:38:32 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:38:38 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:38:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-changed-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG nova.compute.manager [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Refreshing instance network info cache due to event network-changed-b24fb092-3bae-437b-83e0-e22811d79ecd. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] Acquiring lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] Acquired lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Refreshing network info cache for port b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updated VIF entry in instance network info cache for port b24fb092-3bae-437b-83e0-e22811d79ecd. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG nova.network.neutron [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:38:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-de471f0e-2256-4ed7-9e73-a12ff1bfa921 req-cdbe3be6-2f09-4f88-9f0e-157c53e37c60 service nova] Releasing lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'flavor' on Instance uuid e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:47 user nova-compute[76391]: INFO nova.compute.manager [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Attaching volume ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 to /dev/vdb
Nov 15 23:38:47 user nova-compute[76391]: DEBUG os_brick.utils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f33fed-c4f0-4c77-9b48-067367c0fc1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b28f3c-6a06-4183-97cc-4b081fb2750e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ca3bb8-1f6b-41be-84ba-bb03edd98f14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[816ea821-abde-4e7f-aac9-4216f0083f49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:38:47 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:38:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2150c-8e31-4dc8-bc47-a9cae3f575b3]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG os_brick.utils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:38:47 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating existing volume attachment record: f9df1935-4cc0-4dbd-b4a0-606b36cd1e6e {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:38:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNFaVHJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:38:51 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:38:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:38:51 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:38:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:38:51 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:38:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf4c5d1-b52b-4fbd-906b-6011ff81117e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:38:51 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf973910-e577-4527-a392-1a739b905cdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1] added
Nov 15 23:38:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49266eb7-04cc-4c06-a4df-8f3452a09110]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8657466-6778-429a-981b-86a495024f43]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNFaVHJS {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNFaVHJS" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[671e5a8b-4875-4761-b329-56b8e5eb233b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNFaVHJS'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d03744-1327-4f22-bfa9-ef7bae664ece]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4440c43-4f2c-4656-95ff-24783d7fcd4a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:38:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:38:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b36aa02-3795-4a6e-97ee-1421cfb7d6a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260]
Nov 15 23:38:52 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260] successful.
Nov 15 23:38:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5ddfed-0db0-416e-9d4e-3e8ec0c08569]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e851b8e-3918-4d92-8712-41dfdf50a667]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:38:52 user nova-compute[76391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 (non-flash)
Nov 15 23:38:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:38:52 user nova-compute[76391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 (non-flash)
Nov 15 23:38:52 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4e445-f5c6-4232-a6dd-5c2033a5528c]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:38:52 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNFaVHJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26232326161396465', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232326161396465', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'flavor' on Instance uuid e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:38:53 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:38:53 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:38:53 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:38:53 user nova-compute[76391]:   <serial>ed2d7ed5-6033-4d3a-a6da-7093d9f313a1</serial>
Nov 15 23:38:53 user nova-compute[76391]: </disk>
Nov 15 23:38:53 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No VIF found with MAC fa:16:3e:39:bd:b1, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:38:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d7316c65-6ae6-44a3-b3c2-e8cebe2ccfa6 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.642s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:38:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:38:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:38:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:38:56 user nova-compute[76391]: INFO nova.compute.manager [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Detaching volume ed2d7ed5-6033-4d3a-a6da-7093d9f313a1
Nov 15 23:38:56 user nova-compute[76391]: INFO nova.virt.block_device [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Attempting to driver detach volume ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 from mountpoint /dev/vdb
Nov 15 23:38:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Attempting to detach device vdb from instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:38:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:38:56 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:38:56 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:38:56 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:38:56 user nova-compute[76391]:   <serial>ed2d7ed5-6033-4d3a-a6da-7093d9f313a1</serial>
Nov 15 23:38:56 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:38:56 user nova-compute[76391]: </disk>
Nov 15 23:38:56 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:38:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully detached device vdb from instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 from the persistent domain config.
Nov 15 23:38:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:38:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:38:56 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:38:56 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:38:56 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:38:56 user nova-compute[76391]:   <serial>ed2d7ed5-6033-4d3a-a6da-7093d9f313a1</serial>
Nov 15 23:38:56 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:38:56 user nova-compute[76391]: </disk>
Nov 15 23:38:56 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:38:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:38:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:17 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 is timed out.
Nov 15 23:39:17 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully detached device vdb from instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 from the live domain config.
Nov 15 23:39:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNFaVHJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:39:17 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d2b7e-773e-460e-8201-909e6e10372e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:39:17 user nova-compute[76391]: No targets found.
Nov 15 23:39:17 user nova-compute[76391]: iSNS:
Nov 15 23:39:17 user nova-compute[76391]: No targets found.
Nov 15 23:39:17 user nova-compute[76391]: STATIC:
Nov 15 23:39:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d
Nov 15 23:39:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:39:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:39:17 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1
Nov 15 23:39:17 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:39:17 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:39:17 user nova-compute[76391]: FIRMWARE:
Nov 15 23:39:17 user nova-compute[76391]: No targets found.
Nov 15 23:39:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:39:17 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:39:17 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[556cc1bb-7007-4524-b42b-4c5b5e68de2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d48dff-8ff6-46df-a49c-87612f46a12d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:17 user nova-compute[76391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 (non-flash)
Nov 15 23:39:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:17 user nova-compute[76391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 (non-flash)
Nov 15 23:39:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740342200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[066eb7ee-3b69-43c3-bf37-0b7b48a00735]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f13378-1c04-44e5-952e-7aa8e187ce6c]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d97ce-c824-4bdd-8db5-567b636cce30]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43b3c5-4635-49b9-8c60-15025b309fc7]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8432412-d020-422f-b608-464c5b1666f4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9977c704-8c79-4c62-9bea-31c04d2594e6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260]
Nov 15 23:39:17 user nova-compute[76391]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1, portal: 172.16.0.220,3260] successful.
Nov 15 23:39:17 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed2d7ed5-6033-4d3a-a6da-7093d9f313a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca91ad4-9afa-4517-9d2c-dbeffadd1d7f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] <== disconnect_volume: return (316ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:39:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:39:18 user nova-compute[76391]: DEBUG nova.objects.instance [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'flavor' on Instance uuid e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:39:18 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-65475dd6-cc4d-4697-997c-017c6914d223 tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:39:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-changed-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Refreshing instance network info cache due to event network-changed-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] Acquiring lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] Acquired lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Refreshing network info cache for port cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updated VIF entry in instance network info cache for port cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating instance_info_cache with network_info: [{"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:39:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5261cea4-f362-4ee3-8856-a50fee9b7863 req-4194c819-d289-4475-ab94-5cb62a6262c5 service nova] Releasing lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:39:29 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:30 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:39:30 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8570MB free_disk=25.060958862304688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6be3d794-c793-4da2-bfa2-8547215014ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:31 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:39:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:32 user nova-compute[76391]: INFO nova.compute.manager [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attaching volume 3f8099c6-2c80-4aad-8bd1-3e0af7879f7f to /dev/vdb
Nov 15 23:39:32 user nova-compute[76391]: DEBUG os_brick.utils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b7583-19a7-4fa0-a081-4d2063f5d1b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb5efd-1a2c-4f4a-a5ce-36de6330b530]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ac6fd-f160-411a-9ec8-df09c0466a7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ece452-72aa-487a-8a34-874b5c3d9f3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:39:32 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:39:32 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fd09f-504b-4838-95b0-637f4944f6a2]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG os_brick.utils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:39:32 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating existing volume attachment record: 59221762-ec04-45a0-83e6-1026ed236e4a {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:39:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLtqpHbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:39:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:39:36 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:39:36 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c440c588-2128-4d62-8949-702286e628b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:39:36 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe5781-8102-461b-9f75-7c15b15f9473]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f] added
Nov 15 23:39:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b53d3b2-a6f8-4efa-8ba3-936498e5ecaa]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1950811-3d9a-4a1b-9662-5da6e61736fc]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLtqpHbx {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLtqpHbx" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[496db7a4-c3b3-466c-8379-b04a1eac5415]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GLtqpHbx'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8856e-34ce-4539-b725-31f9cf498597]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dcd855-0c63-474b-bf62-fccf66e9ccad]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcf085f-9e0a-40db-9551-6245d573fd8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260]
Nov 15 23:39:36 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260] successful.
Nov 15 23:39:36 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dfabe1-e603-4736-ba8a-3369d92aa40f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48345b74-eeab-4bf1-bd8f-503d6eaa640c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:37 user nova-compute[76391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)
Nov 15 23:39:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:37 user nova-compute[76391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)
Nov 15 23:39:37 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c4ff4-311b-481f-90a3-e1b2b8f1e409]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:39:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLtqpHbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26234613866623937', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234613866623937', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG nova.objects.instance [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:39:38 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:39:38 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:39:38 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:39:38 user nova-compute[76391]:   <serial>3f8099c6-2c80-4aad-8bd1-3e0af7879f7f</serial>
Nov 15 23:39:38 user nova-compute[76391]: </disk>
Nov 15 23:39:38 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No VIF found with MAC fa:16:3e:9c:54:a2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:39:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-8248bf56-0805-4513-b11b-5fc125264231 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.580s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:39:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:42 user nova-compute[76391]: INFO nova.compute.manager [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Terminating instance
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-65ff0c66-14ac-434e-b28a-8bc3bc70ed4b req-c700b6e9-a00c-41b0-94e2-628b21542bd2 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received event network-vif-unplugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-65ff0c66-14ac-434e-b28a-8bc3bc70ed4b req-c700b6e9-a00c-41b0-94e2-628b21542bd2 service nova] Acquiring lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-65ff0c66-14ac-434e-b28a-8bc3bc70ed4b req-c700b6e9-a00c-41b0-94e2-628b21542bd2 service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-65ff0c66-14ac-434e-b28a-8bc3bc70ed4b req-c700b6e9-a00c-41b0-94e2-628b21542bd2 service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-65ff0c66-14ac-434e-b28a-8bc3bc70ed4b req-c700b6e9-a00c-41b0-94e2-628b21542bd2 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] No waiting events found dispatching network-vif-unplugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.compute.manager [req-65ff0c66-14ac-434e-b28a-8bc3bc70ed4b req-c700b6e9-a00c-41b0-94e2-628b21542bd2 service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received event network-vif-unplugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Instance destroyed successfully.
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'resources' on Instance uuid 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1302705859',display_name='tempest-TestVolumeBootPattern-server-1302705859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1302705859',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-zt77vu9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:38:13Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=9dacd7d8-1af2-4a0d-bbe1-8d1d74581582,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "address": "fa:16:3e:5b:14:f7", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dbc480-51", "ovs_interfaceid": "84dbc480-51ec-4ee0-94c3-dae13cdc4bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:14:f7,bridge_name='br-int',has_traffic_filtering=True,id=84dbc480-51ec-4ee0-94c3-dae13cdc4bdc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dbc480-51') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG os_vif [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:14:f7,bridge_name='br-int',has_traffic_filtering=True,id=84dbc480-51ec-4ee0-94c3-dae13cdc4bdc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dbc480-51') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84dbc480-51, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35e47f76-f6d6-436b-abcb-742863d54708) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:42 user nova-compute[76391]: INFO os_vif [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:14:f7,bridge_name='br-int',has_traffic_filtering=True,id=84dbc480-51ec-4ee0-94c3-dae13cdc4bdc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dbc480-51')
Nov 15 23:39:42 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCWJtjSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:39:42 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:39:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8839c308-a2c2-4547-be15-927af3553d69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:39:43 user nova-compute[76391]: No targets found.
Nov 15 23:39:43 user nova-compute[76391]: iSNS:
Nov 15 23:39:43 user nova-compute[76391]: No targets found.
Nov 15 23:39:43 user nova-compute[76391]: STATIC:
Nov 15 23:39:43 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d
Nov 15 23:39:43 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:39:43 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:39:43 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f
Nov 15 23:39:43 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:39:43 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:39:43 user nova-compute[76391]: FIRMWARE:
Nov 15 23:39:43 user nova-compute[76391]: No targets found.
Nov 15 23:39:43 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:39:43 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:39:43 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f899cdc6-1cfe-42ed-ac7f-2a823bbde529]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[047dd271-e1a2-4962-ba23-04243a6d279f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:43 user nova-compute[76391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)
Nov 15 23:39:43 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d (non-flash)
Nov 15 23:39:43 user nova-compute[76391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)
Nov 15 23:39:43 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976048fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[389af6e0-9118-4304-955d-5c0d2d82702a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4114a44b-ef86-4e63-8a20-7a15812af7df]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2611ca9c-4af9-43a3-9bcf-a71da97a800a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b69868d-70ac-440f-b34d-7796a2a0be59]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8727c052-cc9b-48fb-9460-2139dbff5172]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a0756b-e893-4a11-b278-5b04899fb5d6]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260]
Nov 15 23:39:43 user nova-compute[76391]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d, portal: 172.16.0.220,3260] successful.
Nov 15 23:39:43 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9019d5-9326-4b7c-bea1-44fc36e3ea0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f918db-e209-4e24-83ef-7a253fd4fde8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== disconnect_volume: return (301ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:39:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Deleting instance files /opt/stack/data/nova/instances/9dacd7d8-1af2-4a0d-bbe1-8d1d74581582_del
Nov 15 23:39:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Deletion of /opt/stack/data/nova/instances/9dacd7d8-1af2-4a0d-bbe1-8d1d74581582_del complete
Nov 15 23:39:43 user nova-compute[76391]: INFO nova.compute.manager [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 23:39:43 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:39:43 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:39:43 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Took 0.47 seconds to deallocate network for instance.
Nov 15 23:39:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-01ace4e8-8606-400c-b75e-b926d9e26ca3 req-151c3389-8d8a-4c9c-ad69-915092c6459a service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received event network-vif-deleted-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:39:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-b89a87c0-014b-4bd4-8f04-0269eb390e13 req-f1823c97-383d-4bd4-90f2-c9bf472f099c service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received event network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:39:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b89a87c0-014b-4bd4-8f04-0269eb390e13 req-f1823c97-383d-4bd4-90f2-c9bf472f099c service nova] Acquiring lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b89a87c0-014b-4bd4-8f04-0269eb390e13 req-f1823c97-383d-4bd4-90f2-c9bf472f099c service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-b89a87c0-014b-4bd4-8f04-0269eb390e13 req-f1823c97-383d-4bd4-90f2-c9bf472f099c service nova] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-b89a87c0-014b-4bd4-8f04-0269eb390e13 req-f1823c97-383d-4bd4-90f2-c9bf472f099c service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] No waiting events found dispatching network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:39:44 user nova-compute[76391]: WARNING nova.compute.manager [req-b89a87c0-014b-4bd4-8f04-0269eb390e13 req-f1823c97-383d-4bd4-90f2-c9bf472f099c service nova] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Received unexpected event network-vif-plugged-84dbc480-51ec-4ee0-94c3-dae13cdc4bdc for instance with vm_state active and task_state deleting.
Nov 15 23:39:44 user nova-compute[76391]: INFO nova.compute.manager [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Took 0.93 seconds to detach 1 volumes for instance.
Nov 15 23:39:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582] Deleting volume: 1e9019d5-9326-4b7c-bea1-44fc36e3ea0d {{(pid=76391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 23:39:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:45 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:39:45 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:39:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:45 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Deleted allocations for instance 9dacd7d8-1af2-4a0d-bbe1-8d1d74581582
Nov 15 23:39:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2f8857b8-b901-403c-aa75-eb6b29ab76a0 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "9dacd7d8-1af2-4a0d-bbe1-8d1d74581582" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.025s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:39:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:49 user nova-compute[76391]: INFO nova.compute.manager [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Detaching volume 3f8099c6-2c80-4aad-8bd1-3e0af7879f7f
Nov 15 23:39:49 user nova-compute[76391]: INFO nova.virt.block_device [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attempting to driver detach volume 3f8099c6-2c80-4aad-8bd1-3e0af7879f7f from mountpoint /dev/vdb
Nov 15 23:39:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Attempting to detach device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:39:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:39:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:39:49 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:39:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:39:49 user nova-compute[76391]:   <serial>3f8099c6-2c80-4aad-8bd1-3e0af7879f7f</serial>
Nov 15 23:39:49 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:39:49 user nova-compute[76391]: </disk>
Nov 15 23:39:49 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:39:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config.
Nov 15 23:39:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:39:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:39:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:39:49 user nova-compute[76391]:   <source dev="/dev/sdc"/>
Nov 15 23:39:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:39:49 user nova-compute[76391]:   <serial>3f8099c6-2c80-4aad-8bd1-3e0af7879f7f</serial>
Nov 15 23:39:49 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:39:49 user nova-compute[76391]: </disk>
Nov 15 23:39:49 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:39:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:39:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:39:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:51 user nova-compute[76391]: INFO nova.compute.manager [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] instance snapshotting
Nov 15 23:39:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Beginning live snapshot process
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json -f qcow2 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.211s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxsdynyg6/2854dea0dd7b4e8e9966e5703adda867.delta 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxsdynyg6/2854dea0dd7b4e8e9966e5703adda867.delta 1073741824" returned: 0 in 0.050s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 23:39:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] COPY block job progress, current cursor: 458752 final cursor: 75563008 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:39:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 23:39:53 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 23:39:53 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:39:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxsdynyg6/2854dea0dd7b4e8e9966e5703adda867.delta /opt/stack/data/nova/instances/snapshots/tmpxsdynyg6/2854dea0dd7b4e8e9966e5703adda867 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:39:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxsdynyg6/2854dea0dd7b4e8e9966e5703adda867.delta /opt/stack/data/nova/instances/snapshots/tmpxsdynyg6/2854dea0dd7b4e8e9966e5703adda867" returned: 0 in 0.683s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:39:53 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Snapshot extracted, beginning image upload
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:55 user nova-compute[76391]: INFO nova.compute.manager [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Terminating instance
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-7dbf432f-1eb0-40b9-96bc-4ab87d96d4c2 req-c9a33044-a929-4484-a277-9792aa5c5e33 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7dbf432f-1eb0-40b9-96bc-4ab87d96d4c2 req-c9a33044-a929-4484-a277-9792aa5c5e33 service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7dbf432f-1eb0-40b9-96bc-4ab87d96d4c2 req-c9a33044-a929-4484-a277-9792aa5c5e33 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-7dbf432f-1eb0-40b9-96bc-4ab87d96d4c2 req-c9a33044-a929-4484-a277-9792aa5c5e33 service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-7dbf432f-1eb0-40b9-96bc-4ab87d96d4c2 req-c9a33044-a929-4484-a277-9792aa5c5e33 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-7dbf432f-1eb0-40b9-96bc-4ab87d96d4c2 req-c9a33044-a929-4484-a277-9792aa5c5e33 service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-unplugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:39:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Instance destroyed successfully.
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.objects.instance [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'resources' on Instance uuid 6be3d794-c793-4da2-bfa2-8547215014ca {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1699613562',display_name='tempest-AttachVolumeTestJSON-server-1699613562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1699613562',id=39,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkGL6UmWMnJbIfp/e/DkvhX7he351b1pgkRnm55s/1hSGzIWDWH8F8BzkR8+03l0tCcVbQcG41kPnxgEwpD6+WSOIpH0J3R4Sv+mx5M3C1tMKNrqcZiVCDUPZztgKDEmw==',key_name='tempest-keypair-809219275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-tiurycy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:38:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=6be3d794-c793-4da2-bfa2-8547215014ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "address": "fa:16:3e:ec:71:f6", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b8989d-62", "ovs_interfaceid": "e9b8989d-623b-41ab-afe4-80edc71bb67c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG os_vif [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b8989d-62, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b8fd318-a8f7-425e-be1f-9c792e1b945c) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:55 user nova-compute[76391]: INFO os_vif [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:71:f6,bridge_name='br-int',has_traffic_filtering=True,id=e9b8989d-623b-41ab-afe4-80edc71bb67c,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b8989d-62')
Nov 15 23:39:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Deleting instance files /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca_del
Nov 15 23:39:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Deletion of /opt/stack/data/nova/instances/6be3d794-c793-4da2-bfa2-8547215014ca_del complete
Nov 15 23:39:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:39:56 user nova-compute[76391]: INFO nova.compute.manager [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 15 23:39:56 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:39:56 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:39:56 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:39:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Snapshot image upload complete
Nov 15 23:39:56 user nova-compute[76391]: INFO nova.compute.manager [None req-53c427d5-a844-496f-a216-f5d14b99320d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Took 5.51 seconds to snapshot the instance on the hypervisor.
Nov 15 23:39:56 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:39:56 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Took 0.79 seconds to deallocate network for instance.
Nov 15 23:39:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:56 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:39:57 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:39:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:57 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Deleted allocations for instance 6be3d794-c793-4da2-bfa2-8547215014ca
Nov 15 23:39:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-04967cd6-ee79-4b76-b922-5ba1bf8c99dc tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6be3d794-c793-4da2-bfa2-8547215014ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8db25803-a3ce-4bf0-8551-db6dedf68695 req-a59d4a8f-ac62-4251-b6f5-d7fcaaf9a88d service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:39:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8db25803-a3ce-4bf0-8551-db6dedf68695 req-a59d4a8f-ac62-4251-b6f5-d7fcaaf9a88d service nova] Acquiring lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8db25803-a3ce-4bf0-8551-db6dedf68695 req-a59d4a8f-ac62-4251-b6f5-d7fcaaf9a88d service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8db25803-a3ce-4bf0-8551-db6dedf68695 req-a59d4a8f-ac62-4251-b6f5-d7fcaaf9a88d service nova] Lock "6be3d794-c793-4da2-bfa2-8547215014ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8db25803-a3ce-4bf0-8551-db6dedf68695 req-a59d4a8f-ac62-4251-b6f5-d7fcaaf9a88d service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] No waiting events found dispatching network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:39:57 user nova-compute[76391]: WARNING nova.compute.manager [req-8db25803-a3ce-4bf0-8551-db6dedf68695 req-a59d4a8f-ac62-4251-b6f5-d7fcaaf9a88d service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received unexpected event network-vif-plugged-e9b8989d-623b-41ab-afe4-80edc71bb67c for instance with vm_state deleted and task_state None.
Nov 15 23:39:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-8db25803-a3ce-4bf0-8551-db6dedf68695 req-a59d4a8f-ac62-4251-b6f5-d7fcaaf9a88d service nova] [instance: 6be3d794-c793-4da2-bfa2-8547215014ca] Received event network-vif-deleted-e9b8989d-623b-41ab-afe4-80edc71bb67c {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:39:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:39:59 user nova-compute[76391]: INFO nova.compute.claims [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Claim successful on node user
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:39:59 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.policy [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df069f99697e4424ac6c833251e9c47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f84553fb9741ee9ce5b74fa602b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:39:59 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Creating image(s)
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "/opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "/opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "/opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "b580f13412035ffeb89ca5a285cca49dfe67924b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:39:59 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "b580f13412035ffeb89ca5a285cca49dfe67924b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.part --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Successfully created port: b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.part --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG nova.virt.images [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] ce5c8496-4a32-413e-afb3-3559eaf2ea0b was qcow2, converting to raw {{(pid=76391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG nova.privsep.utils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.part /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.converted {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.part /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.converted" returned: 0 in 0.683s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.converted --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Successfully updated port: b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-changed-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Refreshing instance network info cache due to event network-changed-b180fa3a-5c39-4f30-892e-793585c248ec. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] Acquiring lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] Acquired lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.network.neutron [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Refreshing network info cache for port b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.network.neutron [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "b580f13412035ffeb89ca5a285cca49dfe67924b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.006s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.network.neutron [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-91d941a3-b32e-4c83-9833-a00cf8d79fbd req-162b5cb2-f973-4224-9fc1-aee116871fbd service nova] Releasing lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquired lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "b580f13412035ffeb89ca5a285cca49dfe67924b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "b580f13412035ffeb89ca5a285cca49dfe67924b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:01 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b,backing_fmt=raw /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b,backing_fmt=raw /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk 1073741824" returned: 0 in 0.051s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "b580f13412035ffeb89ca5a285cca49dfe67924b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.network.neutron [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updating instance_info_cache with network_info: [{"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Releasing lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Instance network_info: |[{"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Ensure instance console log exists: /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Start _get_guest_xml network_info=[{"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='155a7dbb891d75697ad04da240fef926',container_format='bare',created_at=2023-11-15T23:39:51Z,direct_url=<?>,disk_format='qcow2',id=ce5c8496-4a32-413e-afb3-3559eaf2ea0b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1816725849',owner='14f84553fb9741ee9ce5b74fa602b637',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T23:39:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': 'ce5c8496-4a32-413e-afb3-3559eaf2ea0b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:40:02 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:02 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='155a7dbb891d75697ad04da240fef926',container_format='bare',created_at=2023-11-15T23:39:51Z,direct_url=<?>,disk_format='qcow2',id=ce5c8496-4a32-413e-afb3-3559eaf2ea0b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1816725849',owner='14f84553fb9741ee9ce5b74fa602b637',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T23:39:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-536438635',display_name='tempest-TestStampPattern-server-536438635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-536438635',id=46,image_ref='ce5c8496-4a32-413e-afb3-3559eaf2ea0b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDDSQ6k1cWwyS4WEd+yxAmvqQBEiExgn9f0DCEC8t6J855pUVXshZfGp1Bp7GX0xD5JJvzuJe44aIByWAyKotYhrTJuqO0XXhT5W+g+6AFBTdITap7Mbj/L0/6KVkJDFQ==',key_name='tempest-TestStampPattern-1250583077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14f84553fb9741ee9ce5b74fa602b637',ramdisk_id='',reservation_id='r-jl1n0cgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e482ec5d-8630-4d09-9100-aa9ac345ecb3',image_min_disk='1',image_min_ram='0',image_owner_id='14f84553fb9741ee9ce5b74fa602b637',image_owner_project_name='tempest-TestStampPattern-1891858582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1891858582-project-member',image_user_id='df069f99697e4424ac6c833251e9c47c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1891858582',owner_user_name='tempest-TestStampPattern-1891858582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:40:00Z,user_data=None,user_id='df069f99697e4424ac6c833251e9c47c',uuid=f66fbb3a-6f83-4792-b171-ebd6ba021540,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converting VIF {"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:bd:d8,bridge_name='br-int',has_traffic_filtering=True,id=b180fa3a-5c39-4f30-892e-793585c248ec,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb180fa3a-5c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'pci_devices' on Instance uuid f66fbb3a-6f83-4792-b171-ebd6ba021540 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:40:02 user nova-compute[76391]:   <uuid>f66fbb3a-6f83-4792-b171-ebd6ba021540</uuid>
Nov 15 23:40:02 user nova-compute[76391]:   <name>instance-0000002e</name>
Nov 15 23:40:02 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:40:02 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:40:02 user nova-compute[76391]:   <metadata>
Nov 15 23:40:02 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:40:02 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:40:02 user nova-compute[76391]:       <nova:name>tempest-TestStampPattern-server-536438635</nova:name>
Nov 15 23:40:02 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:40:02</nova:creationTime>
Nov 15 23:40:02 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:40:02 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:40:02 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:40:02 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:40:02 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:40:02 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:40:02 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:40:02 user nova-compute[76391]:       <nova:owner>
Nov 15 23:40:02 user nova-compute[76391]:         <nova:user uuid="df069f99697e4424ac6c833251e9c47c">tempest-TestStampPattern-1891858582-project-member</nova:user>
Nov 15 23:40:02 user nova-compute[76391]:         <nova:project uuid="14f84553fb9741ee9ce5b74fa602b637">tempest-TestStampPattern-1891858582</nova:project>
Nov 15 23:40:02 user nova-compute[76391]:       </nova:owner>
Nov 15 23:40:02 user nova-compute[76391]:       <nova:root type="image" uuid="ce5c8496-4a32-413e-afb3-3559eaf2ea0b"/>
Nov 15 23:40:02 user nova-compute[76391]:       <nova:ports>
Nov 15 23:40:02 user nova-compute[76391]:         <nova:port uuid="b180fa3a-5c39-4f30-892e-793585c248ec">
Nov 15 23:40:02 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 23:40:02 user nova-compute[76391]:         </nova:port>
Nov 15 23:40:02 user nova-compute[76391]:       </nova:ports>
Nov 15 23:40:02 user nova-compute[76391]:     </nova:instance>
Nov 15 23:40:02 user nova-compute[76391]:   </metadata>
Nov 15 23:40:02 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:40:02 user nova-compute[76391]:     <system>
Nov 15 23:40:02 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:40:02 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:40:02 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:40:02 user nova-compute[76391]:       <entry name="serial">f66fbb3a-6f83-4792-b171-ebd6ba021540</entry>
Nov 15 23:40:02 user nova-compute[76391]:       <entry name="uuid">f66fbb3a-6f83-4792-b171-ebd6ba021540</entry>
Nov 15 23:40:02 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:40:02 user nova-compute[76391]:     </system>
Nov 15 23:40:02 user nova-compute[76391]:   </sysinfo>
Nov 15 23:40:02 user nova-compute[76391]:   <os>
Nov 15 23:40:02 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:40:02 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:40:02 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:40:02 user nova-compute[76391]:   </os>
Nov 15 23:40:02 user nova-compute[76391]:   <features>
Nov 15 23:40:02 user nova-compute[76391]:     <acpi/>
Nov 15 23:40:02 user nova-compute[76391]:     <apic/>
Nov 15 23:40:02 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:40:02 user nova-compute[76391]:   </features>
Nov 15 23:40:02 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:40:02 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:40:02 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:40:02 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:40:02 user nova-compute[76391]:   </clock>
Nov 15 23:40:02 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:40:02 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:40:02 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:40:02 user nova-compute[76391]:   </cpu>
Nov 15 23:40:02 user nova-compute[76391]:   <devices>
Nov 15 23:40:02 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:40:02 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:40:02 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk"/>
Nov 15 23:40:02 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:40:02 user nova-compute[76391]:     </disk>
Nov 15 23:40:02 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:40:02 user nova-compute[76391]:       <mac address="fa:16:3e:14:bd:d8"/>
Nov 15 23:40:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:40:02 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:40:02 user nova-compute[76391]:       <target dev="tapb180fa3a-5c"/>
Nov 15 23:40:02 user nova-compute[76391]:     </interface>
Nov 15 23:40:02 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:40:02 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/console.log" append="off"/>
Nov 15 23:40:02 user nova-compute[76391]:     </serial>
Nov 15 23:40:02 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:40:02 user nova-compute[76391]:     <video>
Nov 15 23:40:02 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:40:02 user nova-compute[76391]:     </video>
Nov 15 23:40:02 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:40:02 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:40:02 user nova-compute[76391]:     </rng>
Nov 15 23:40:02 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:40:02 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:40:02 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:40:02 user nova-compute[76391]:     </memballoon>
Nov 15 23:40:02 user nova-compute[76391]:   </devices>
Nov 15 23:40:02 user nova-compute[76391]: </domain>
Nov 15 23:40:02 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-536438635',display_name='tempest-TestStampPattern-server-536438635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-536438635',id=46,image_ref='ce5c8496-4a32-413e-afb3-3559eaf2ea0b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDDSQ6k1cWwyS4WEd+yxAmvqQBEiExgn9f0DCEC8t6J855pUVXshZfGp1Bp7GX0xD5JJvzuJe44aIByWAyKotYhrTJuqO0XXhT5W+g+6AFBTdITap7Mbj/L0/6KVkJDFQ==',key_name='tempest-TestStampPattern-1250583077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14f84553fb9741ee9ce5b74fa602b637',ramdisk_id='',reservation_id='r-jl1n0cgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e482ec5d-8630-4d09-9100-aa9ac345ecb3',image_min_disk='1',image_min_ram='0',image_owner_id='14f84553fb9741ee9ce5b74fa602b637',image_owner_project_name='tempest-TestStampPattern-1891858582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1891858582-project-member',image_user_id='df069f99697e4424ac6c833251e9c47c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1891858582',owner_user_name='tempest-TestStampPattern-1891858582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:40:00Z,user_data=None,user_id='df069f99697e4424ac6c833251e9c47c',uuid=f66fbb3a-6f83-4792-b171-ebd6ba021540,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converting VIF {"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:bd:d8,bridge_name='br-int',has_traffic_filtering=True,id=b180fa3a-5c39-4f30-892e-793585c248ec,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb180fa3a-5c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG os_vif [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:bd:d8,bridge_name='br-int',has_traffic_filtering=True,id=b180fa3a-5c39-4f30-892e-793585c248ec,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb180fa3a-5c') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48ee8b7a-8953-50fd-a6e3-2c4eb673e0ff', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb180fa3a-5c, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb180fa3a-5c, col_values=(('qos', UUID('84c5415d-b1fd-4faa-b508-7a2b2e8c5923')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb180fa3a-5c, col_values=(('external_ids', {'iface-id': 'b180fa3a-5c39-4f30-892e-793585c248ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:bd:d8', 'vm-uuid': 'f66fbb3a-6f83-4792-b171-ebd6ba021540'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:02 user nova-compute[76391]: INFO os_vif [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:bd:d8,bridge_name='br-int',has_traffic_filtering=True,id=b180fa3a-5c39-4f30-892e-793585c248ec,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb180fa3a-5c')
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:40:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No VIF found with MAC fa:16:3e:14:bd:d8, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-79cf5f31-f03b-4c57-908c-a31883b3e7d5 req-e1f1171a-d2bf-4570-b362-563b3c7b716d service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79cf5f31-f03b-4c57-908c-a31883b3e7d5 req-e1f1171a-d2bf-4570-b362-563b3c7b716d service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79cf5f31-f03b-4c57-908c-a31883b3e7d5 req-e1f1171a-d2bf-4570-b362-563b3c7b716d service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-79cf5f31-f03b-4c57-908c-a31883b3e7d5 req-e1f1171a-d2bf-4570-b362-563b3c7b716d service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-79cf5f31-f03b-4c57-908c-a31883b3e7d5 req-e1f1171a-d2bf-4570-b362-563b3c7b716d service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:40:03 user nova-compute[76391]: WARNING nova.compute.manager [req-79cf5f31-f03b-4c57-908c-a31883b3e7d5 req-e1f1171a-d2bf-4570-b362-563b3c7b716d service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state building and task_state spawning.
Nov 15 23:40:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:40:05 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Instance spawned successfully.
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:05 user nova-compute[76391]: INFO nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-aa2c2415-c05d-475f-b78f-3dae84966066 req-03d9f3f4-ffbe-4636-a118-363b7213b1b0 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aa2c2415-c05d-475f-b78f-3dae84966066 req-03d9f3f4-ffbe-4636-a118-363b7213b1b0 service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aa2c2415-c05d-475f-b78f-3dae84966066 req-03d9f3f4-ffbe-4636-a118-363b7213b1b0 service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aa2c2415-c05d-475f-b78f-3dae84966066 req-03d9f3f4-ffbe-4636-a118-363b7213b1b0 service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-aa2c2415-c05d-475f-b78f-3dae84966066 req-03d9f3f4-ffbe-4636-a118-363b7213b1b0 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:40:05 user nova-compute[76391]: WARNING nova.compute.manager [req-aa2c2415-c05d-475f-b78f-3dae84966066 req-03d9f3f4-ffbe-4636-a118-363b7213b1b0 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state building and task_state spawning.
Nov 15 23:40:05 user nova-compute[76391]: INFO nova.compute.manager [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Took 6.89 seconds to build instance.
Nov 15 23:40:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e33f85a2-395c-4044-8bbe-7f91205c88ab tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.997s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:10 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 is timed out.
Nov 15 23:40:10 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config.
Nov 15 23:40:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLtqpHbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:40:10 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1f9a86-17bd-47dd-badc-15a33a447d77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:40:10 user nova-compute[76391]: No targets found.
Nov 15 23:40:10 user nova-compute[76391]: iSNS:
Nov 15 23:40:10 user nova-compute[76391]: No targets found.
Nov 15 23:40:10 user nova-compute[76391]: STATIC:
Nov 15 23:40:10 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f
Nov 15 23:40:10 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:40:10 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:40:10 user nova-compute[76391]: FIRMWARE:
Nov 15 23:40:10 user nova-compute[76391]: No targets found.
Nov 15 23:40:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:40:10 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:40:10 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[390abc8c-c5f8-484c-a446-51f8c662885e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2140deaa-8270-49df-b2ba-a1bf78f7be2c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)
Nov 15 23:40:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f (non-flash)
Nov 15 23:40:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740359360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5433d85-d2f8-46aa-a9dc-840389e6e4eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a98763-a124-431d-ba83-22123bf475c3]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e4501c-cdc7-41da-8b4d-0058a06279d2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a380d7-d998-44d8-9292-d72c0e0cf31e]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a48cc7-697e-4f3e-96b5-5e89355f68eb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a990b2-6042-47e6-aae8-9a42e1114ef4]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260]
Nov 15 23:40:10 user nova-compute[76391]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f, portal: 172.16.0.220,3260] successful.
Nov 15 23:40:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8099c6-2c80-4aad-8bd1-3e0af7879f7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc147f0-b440-4b72-bd98-ece1d691dfa1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== disconnect_volume: return (288ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:40:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:40:11 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:40:11 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d06a2ffe-1932-4af1-8c27-e758cbde561e tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:40:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:31 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:31 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:31 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8600MB free_disk=24.934226989746094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance f66fbb3a-6f83-4792-b171-ebd6ba021540 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating instance_info_cache with network_info: [{"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:40:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:40:34 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:40:41 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:40:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:40:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:42 user nova-compute[76391]: INFO nova.compute.manager [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attaching volume 3b731c5e-a5c9-4f35-8197-5b91239f9026 to /dev/vdb
Nov 15 23:40:42 user nova-compute[76391]: DEBUG os_brick.utils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc56b8-9c61-455f-be37-dd581023c11f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fe13df-fc8e-4760-b08b-9ce1ed4d71aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3ec3cc-172e-4242-9f5e-1ced2fc4a0fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a35d9c-e78c-48b8-a286-c52205e46834]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:40:42 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e38311-d20d-4bc3-ba5a-5a8092ce199c]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG os_brick.utils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating existing volume attachment record: abb74100-2c21-4e7a-8d74-a924010d27f1 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:40:42 user nova-compute[76391]: INFO nova.compute.claims [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Claim successful on node user
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:40:42 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG nova.policy [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8b2b277f69f480f8a2c102a46792247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b3dc7e25d24f309b8c4bb7be5ad0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:40:42 user nova-compute[76391]: INFO nova.virt.block_device [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Booting with volume 33ecbbc4-0747-407e-ac4d-8422e3089efb at /dev/vda
Nov 15 23:40:42 user nova-compute[76391]: DEBUG os_brick.utils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96559ad-876f-47e4-aefa-91ab44f2847b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aa1df4-5ba8-430e-9733-586540556346]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7546c95b-9c7a-478e-a437-19db0a8b82cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4a161-0b5c-4dc4-a3a6-be3549fe666e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:42 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:40:43 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:40:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f59a5a6-766c-4f66-af70-43400ca5a4a8]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG os_brick.utils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updating existing volume attachment record: 4af3abe4-c7be-4e35-b582-e8a02a5185e6 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:40:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Successfully created port: cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Successfully updated port: cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquired lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-changed-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.compute.manager [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Refreshing instance network info cache due to event network-changed-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] Acquiring lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.network.neutron [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updating instance_info_cache with network_info: [{"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Releasing lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Instance network_info: |[{"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] Acquired lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Refreshing network info cache for port cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updated VIF entry in instance network info cache for port cffe0d3c-a19c-4bd3-a559-55a9a2cee6de. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG nova.network.neutron [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updating instance_info_cache with network_info: [{"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:40:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-dc33444c-b8f5-4d4c-b9a2-fdb286ee2761 req-5ee8e6dd-0b81-4ad0-8e1e-7bac6782ec45 service nova] Releasing lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiBtDyfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:40:46 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:40:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:40:46 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:40:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:40:46 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:40:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a429763-cdd6-4988-89e1-73a2ba7533b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:40:46 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e61a1e-2cc6-4935-8f16-698827756f0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026] added
Nov 15 23:40:46 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f2b516-df5d-40eb-9654-9579b67c20b5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc3c1d-c7ee-42da-ad36-12e9ae52ee6f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiBtDyfl {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiBtDyfl" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58781374-022d-4276-80ab-39b3105b5e17]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PiBtDyfl'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[622edf63-1abf-434e-b1c6-33a33a2e169d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28ff700-3200-48be-91c0-d9a93afbce6c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:40:47 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:40:47 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:40:47 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:40:47 user nova-compute[76391]: 
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a47b78-f76f-47de-affd-2d6a60790214]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260]
Nov 15 23:40:47 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260] successful.
Nov 15 23:40:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae02e46-2033-4c67-b545-91543e6a8c6f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d6b325-fc94-4baf-8e44-40b431b0b43e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:40:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:40:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e267d4-121b-497d-9316-7f6dc453c704]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:40:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:40:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Creating image(s)
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Ensure instance console log exists: /opt/stack/data/nova/instances/19794d53-9572-436b-b2b5-cdd2c7d342bb/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Start _get_guest_xml network_info=[{"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspzrbLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19794d53-9572-436b-b2b5-cdd2c7d342bb', 'attached_at': '', 'detached_at': '', 'volume_id': '33ecbbc4-0747-407e-ac4d-8422e3089efb', 'serial': '33ecbbc4-0747-407e-ac4d-8422e3089efb'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '4af3abe4-c7be-4e35-b582-e8a02a5185e6', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:40:48 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:48 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspzrbLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:40:48 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiBtDyfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26466373636343466', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466373636343466', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.094s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:40:48 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:40:48 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.objects.instance [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d8310-6a7f-4070-90c5-c1b5f2656a19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:40:48 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:40:48 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:40:48 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:40:48 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:40:48 user nova-compute[76391]:   <serial>3b731c5e-a5c9-4f35-8197-5b91239f9026</serial>
Nov 15 23:40:48 user nova-compute[76391]: </disk>
Nov 15 23:40:48 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e312f-f995-4c5a-a5ee-7630d18f2291]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb] added
Nov 15 23:40:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8836a3-ba77-4d80-9b30-e7860b7b2453]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e258300f-dc17-4656-9647-7bd8b52a6dd0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yspzrbLl {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yspzrbLl" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[397e3a03-db4c-4b66-9b7f-85d6fa8c93cc]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yspzrbLl'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6121630-a8d4-441f-9bd1-6c1d9792371c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa254257-cde5-4713-a26a-0c3a4ae25c27]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:40:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:40:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d1347-c390-42fc-b3fe-4d80dde8121c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260]
Nov 15 23:40:48 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260] successful.
Nov 15 23:40:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab01ab3-38d1-47d1-8d8b-23e023a6b013]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.077s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9002efba-fc9f-43b5-a044-b413932e1d74]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:40:48 user nova-compute[76391]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:40:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:40:48 user nova-compute[76391]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:40:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[399adfc9-638b-467e-9aff-2277426103b4]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspzrbLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No VIF found with MAC fa:16:3e:9c:54:a2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:40:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-cbe81026-2b8d-4575-9027-303ac1c5e7d6 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.794s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23961353032326462', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961353032326462', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-304361143',display_name='tempest-TestVolumeBootPattern-volume-backed-server-304361143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-304361143',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEA+9/98OjjrpIy5x6yCN6GqehH0ubuVdd96IXONjDVBnBAouPDM7WXFpWfw4hznpltxdLiRgAP5YD7Rqy9pBTKrbJNEsFK4VlEmEk3AejWczHrh/QamqCvdlBXUN5jhgQ==',key_name='tempest-keypair-1377286807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-jyfr3m9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:40:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8b2b277f69f480f8a2c102a46792247',uuid=19794d53-9572-436b-b2b5-cdd2c7d342bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:9c:da,bridge_name='br-int',has_traffic_filtering=True,id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffe0d3c-a1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'pci_devices' on Instance uuid 19794d53-9572-436b-b2b5-cdd2c7d342bb {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:40:49 user nova-compute[76391]:   <uuid>19794d53-9572-436b-b2b5-cdd2c7d342bb</uuid>
Nov 15 23:40:49 user nova-compute[76391]:   <name>instance-0000002f</name>
Nov 15 23:40:49 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:40:49 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:40:49 user nova-compute[76391]:   <metadata>
Nov 15 23:40:49 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:40:49 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:40:49 user nova-compute[76391]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-304361143</nova:name>
Nov 15 23:40:49 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:40:48</nova:creationTime>
Nov 15 23:40:49 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:40:49 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:40:49 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:40:49 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:40:49 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:40:49 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:40:49 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:40:49 user nova-compute[76391]:       <nova:owner>
Nov 15 23:40:49 user nova-compute[76391]:         <nova:user uuid="b8b2b277f69f480f8a2c102a46792247">tempest-TestVolumeBootPattern-1132666866-project-member</nova:user>
Nov 15 23:40:49 user nova-compute[76391]:         <nova:project uuid="93b3dc7e25d24f309b8c4bb7be5ad0f2">tempest-TestVolumeBootPattern-1132666866</nova:project>
Nov 15 23:40:49 user nova-compute[76391]:       </nova:owner>
Nov 15 23:40:49 user nova-compute[76391]:       <nova:ports>
Nov 15 23:40:49 user nova-compute[76391]:         <nova:port uuid="cffe0d3c-a19c-4bd3-a559-55a9a2cee6de">
Nov 15 23:40:49 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 23:40:49 user nova-compute[76391]:         </nova:port>
Nov 15 23:40:49 user nova-compute[76391]:       </nova:ports>
Nov 15 23:40:49 user nova-compute[76391]:     </nova:instance>
Nov 15 23:40:49 user nova-compute[76391]:   </metadata>
Nov 15 23:40:49 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:40:49 user nova-compute[76391]:     <system>
Nov 15 23:40:49 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:40:49 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:40:49 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:40:49 user nova-compute[76391]:       <entry name="serial">19794d53-9572-436b-b2b5-cdd2c7d342bb</entry>
Nov 15 23:40:49 user nova-compute[76391]:       <entry name="uuid">19794d53-9572-436b-b2b5-cdd2c7d342bb</entry>
Nov 15 23:40:49 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:40:49 user nova-compute[76391]:     </system>
Nov 15 23:40:49 user nova-compute[76391]:   </sysinfo>
Nov 15 23:40:49 user nova-compute[76391]:   <os>
Nov 15 23:40:49 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:40:49 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:40:49 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:40:49 user nova-compute[76391]:   </os>
Nov 15 23:40:49 user nova-compute[76391]:   <features>
Nov 15 23:40:49 user nova-compute[76391]:     <acpi/>
Nov 15 23:40:49 user nova-compute[76391]:     <apic/>
Nov 15 23:40:49 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:40:49 user nova-compute[76391]:   </features>
Nov 15 23:40:49 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:40:49 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:40:49 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:40:49 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:40:49 user nova-compute[76391]:   </clock>
Nov 15 23:40:49 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:40:49 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:40:49 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:40:49 user nova-compute[76391]:   </cpu>
Nov 15 23:40:49 user nova-compute[76391]:   <devices>
Nov 15 23:40:49 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:40:49 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:40:49 user nova-compute[76391]:       <source dev="/dev/sdc"/>
Nov 15 23:40:49 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:40:49 user nova-compute[76391]:       <serial>33ecbbc4-0747-407e-ac4d-8422e3089efb</serial>
Nov 15 23:40:49 user nova-compute[76391]:     </disk>
Nov 15 23:40:49 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:40:49 user nova-compute[76391]:       <mac address="fa:16:3e:92:9c:da"/>
Nov 15 23:40:49 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:40:49 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:40:49 user nova-compute[76391]:       <target dev="tapcffe0d3c-a1"/>
Nov 15 23:40:49 user nova-compute[76391]:     </interface>
Nov 15 23:40:49 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:40:49 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/19794d53-9572-436b-b2b5-cdd2c7d342bb/console.log" append="off"/>
Nov 15 23:40:49 user nova-compute[76391]:     </serial>
Nov 15 23:40:49 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:40:49 user nova-compute[76391]:     <video>
Nov 15 23:40:49 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:40:49 user nova-compute[76391]:     </video>
Nov 15 23:40:49 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:40:49 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:40:49 user nova-compute[76391]:     </rng>
Nov 15 23:40:49 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:40:49 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:40:49 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:40:49 user nova-compute[76391]:     </memballoon>
Nov 15 23:40:49 user nova-compute[76391]:   </devices>
Nov 15 23:40:49 user nova-compute[76391]: </domain>
Nov 15 23:40:49 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-304361143',display_name='tempest-TestVolumeBootPattern-volume-backed-server-304361143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-304361143',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEA+9/98OjjrpIy5x6yCN6GqehH0ubuVdd96IXONjDVBnBAouPDM7WXFpWfw4hznpltxdLiRgAP5YD7Rqy9pBTKrbJNEsFK4VlEmEk3AejWczHrh/QamqCvdlBXUN5jhgQ==',key_name='tempest-keypair-1377286807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-jyfr3m9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:40:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8b2b277f69f480f8a2c102a46792247',uuid=19794d53-9572-436b-b2b5-cdd2c7d342bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:9c:da,bridge_name='br-int',has_traffic_filtering=True,id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffe0d3c-a1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG os_vif [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:9c:da,bridge_name='br-int',has_traffic_filtering=True,id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffe0d3c-a1') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01f0a256-ac3c-5363-9bfc-47975aa4dace', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:40:49 user nova-compute[76391]: INFO nova.compute.claims [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Claim successful on node user
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcffe0d3c-a1, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcffe0d3c-a1, col_values=(('qos', UUID('ffce88a1-2b79-4995-89c5-4eb31fdcaf38')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcffe0d3c-a1, col_values=(('external_ids', {'iface-id': 'cffe0d3c-a19c-4bd3-a559-55a9a2cee6de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:9c:da', 'vm-uuid': '19794d53-9572-436b-b2b5-cdd2c7d342bb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:49 user nova-compute[76391]: INFO os_vif [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:9c:da,bridge_name='br-int',has_traffic_filtering=True,id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffe0d3c-a1')
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No VIF found with MAC fa:16:3e:92:9c:da, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:40:50 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.policy [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efa0b862a4e54967ba27a6cc88bb5496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f76509cb8a4588a018268eee3eb14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:40:50 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Creating image(s)
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "/opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "/opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "/opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.037s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk 1073741824" returned: 0 in 0.064s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Successfully created port: f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:40:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Cannot resize image /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Ensure instance console log exists: /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-3b00c4e5-8884-48ea-9d8b-ba341e752bd9 req-09f04502-9f12-459b-a898-f40fdc7e1481 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3b00c4e5-8884-48ea-9d8b-ba341e752bd9 req-09f04502-9f12-459b-a898-f40fdc7e1481 service nova] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3b00c4e5-8884-48ea-9d8b-ba341e752bd9 req-09f04502-9f12-459b-a898-f40fdc7e1481 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3b00c4e5-8884-48ea-9d8b-ba341e752bd9 req-09f04502-9f12-459b-a898-f40fdc7e1481 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-3b00c4e5-8884-48ea-9d8b-ba341e752bd9 req-09f04502-9f12-459b-a898-f40fdc7e1481 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] No waiting events found dispatching network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:40:51 user nova-compute[76391]: WARNING nova.compute.manager [req-3b00c4e5-8884-48ea-9d8b-ba341e752bd9 req-09f04502-9f12-459b-a898-f40fdc7e1481 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received unexpected event network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de for instance with vm_state building and task_state spawning.
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:51 user nova-compute[76391]: INFO nova.compute.manager [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Detaching volume 3b731c5e-a5c9-4f35-8197-5b91239f9026
Nov 15 23:40:51 user nova-compute[76391]: INFO nova.virt.block_device [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attempting to driver detach volume 3b731c5e-a5c9-4f35-8197-5b91239f9026 from mountpoint /dev/vdb
Nov 15 23:40:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Attempting to detach device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:40:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:40:51 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:40:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:40:51 user nova-compute[76391]:   <serial>3b731c5e-a5c9-4f35-8197-5b91239f9026</serial>
Nov 15 23:40:51 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:40:51 user nova-compute[76391]: </disk>
Nov 15 23:40:51 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:40:51 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config.
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:40:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:40:51 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:40:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:40:51 user nova-compute[76391]:   <serial>3b731c5e-a5c9-4f35-8197-5b91239f9026</serial>
Nov 15 23:40:51 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:40:51 user nova-compute[76391]: </disk>
Nov 15 23:40:51 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Successfully updated port: f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquired lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-changed-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Refreshing instance network info cache due to event network-changed-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] Acquiring lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:40:51 user nova-compute[76391]: DEBUG nova.network.neutron [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updating instance_info_cache with network_info: [{"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Releasing lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Instance network_info: |[{"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] Acquired lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Refreshing network info cache for port f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Start _get_guest_xml network_info=[{"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:40:52 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:52 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1533543857',display_name='tempest-AttachVolumeTestJSON-server-1533543857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1533543857',id=48,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRsospcNw7YOB3v/aU38ZShy/HBnzK4N6d+nxnYUhzFKpCqSIMIx42VWxnqHCnF/s0+tUTuTe0dQxTOg2O4Fh1iI+xfvlqQbgx3pSLMgZT8bjtnctHqFePiHCOAI33CVw==',key_name='tempest-keypair-1702131576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-0lchui8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=396feab9-f7a6-4983-aaa9-59eb99677740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:e4:c2,bridge_name='br-int',has_traffic_filtering=True,id=f5c79a0e-cb9c-40a0-ba5e-95d9f6050906,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c79a0e-cb') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'pci_devices' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:40:52 user nova-compute[76391]:   <uuid>396feab9-f7a6-4983-aaa9-59eb99677740</uuid>
Nov 15 23:40:52 user nova-compute[76391]:   <name>instance-00000030</name>
Nov 15 23:40:52 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:40:52 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:40:52 user nova-compute[76391]:   <metadata>
Nov 15 23:40:52 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:40:52 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:40:52 user nova-compute[76391]:       <nova:name>tempest-AttachVolumeTestJSON-server-1533543857</nova:name>
Nov 15 23:40:52 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:40:52</nova:creationTime>
Nov 15 23:40:52 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:40:52 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:40:52 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:40:52 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:40:52 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:40:52 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:40:52 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:40:52 user nova-compute[76391]:       <nova:owner>
Nov 15 23:40:52 user nova-compute[76391]:         <nova:user uuid="efa0b862a4e54967ba27a6cc88bb5496">tempest-AttachVolumeTestJSON-1495860226-project-member</nova:user>
Nov 15 23:40:52 user nova-compute[76391]:         <nova:project uuid="28f76509cb8a4588a018268eee3eb14a">tempest-AttachVolumeTestJSON-1495860226</nova:project>
Nov 15 23:40:52 user nova-compute[76391]:       </nova:owner>
Nov 15 23:40:52 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:40:52 user nova-compute[76391]:       <nova:ports>
Nov 15 23:40:52 user nova-compute[76391]:         <nova:port uuid="f5c79a0e-cb9c-40a0-ba5e-95d9f6050906">
Nov 15 23:40:52 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 23:40:52 user nova-compute[76391]:         </nova:port>
Nov 15 23:40:52 user nova-compute[76391]:       </nova:ports>
Nov 15 23:40:52 user nova-compute[76391]:     </nova:instance>
Nov 15 23:40:52 user nova-compute[76391]:   </metadata>
Nov 15 23:40:52 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:40:52 user nova-compute[76391]:     <system>
Nov 15 23:40:52 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:40:52 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:40:52 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:40:52 user nova-compute[76391]:       <entry name="serial">396feab9-f7a6-4983-aaa9-59eb99677740</entry>
Nov 15 23:40:52 user nova-compute[76391]:       <entry name="uuid">396feab9-f7a6-4983-aaa9-59eb99677740</entry>
Nov 15 23:40:52 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:40:52 user nova-compute[76391]:     </system>
Nov 15 23:40:52 user nova-compute[76391]:   </sysinfo>
Nov 15 23:40:52 user nova-compute[76391]:   <os>
Nov 15 23:40:52 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:40:52 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:40:52 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:40:52 user nova-compute[76391]:   </os>
Nov 15 23:40:52 user nova-compute[76391]:   <features>
Nov 15 23:40:52 user nova-compute[76391]:     <acpi/>
Nov 15 23:40:52 user nova-compute[76391]:     <apic/>
Nov 15 23:40:52 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:40:52 user nova-compute[76391]:   </features>
Nov 15 23:40:52 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:40:52 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:40:52 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:40:52 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:40:52 user nova-compute[76391]:   </clock>
Nov 15 23:40:52 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:40:52 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:40:52 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:40:52 user nova-compute[76391]:   </cpu>
Nov 15 23:40:52 user nova-compute[76391]:   <devices>
Nov 15 23:40:52 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:40:52 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:40:52 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk"/>
Nov 15 23:40:52 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:40:52 user nova-compute[76391]:     </disk>
Nov 15 23:40:52 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:40:52 user nova-compute[76391]:       <mac address="fa:16:3e:40:e4:c2"/>
Nov 15 23:40:52 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:40:52 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:40:52 user nova-compute[76391]:       <target dev="tapf5c79a0e-cb"/>
Nov 15 23:40:52 user nova-compute[76391]:     </interface>
Nov 15 23:40:52 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:40:52 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/console.log" append="off"/>
Nov 15 23:40:52 user nova-compute[76391]:     </serial>
Nov 15 23:40:52 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:40:52 user nova-compute[76391]:     <video>
Nov 15 23:40:52 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:40:52 user nova-compute[76391]:     </video>
Nov 15 23:40:52 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:40:52 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:40:52 user nova-compute[76391]:     </rng>
Nov 15 23:40:52 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:40:52 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:40:52 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:40:52 user nova-compute[76391]:     </memballoon>
Nov 15 23:40:52 user nova-compute[76391]:   </devices>
Nov 15 23:40:52 user nova-compute[76391]: </domain>
Nov 15 23:40:52 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1533543857',display_name='tempest-AttachVolumeTestJSON-server-1533543857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1533543857',id=48,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRsospcNw7YOB3v/aU38ZShy/HBnzK4N6d+nxnYUhzFKpCqSIMIx42VWxnqHCnF/s0+tUTuTe0dQxTOg2O4Fh1iI+xfvlqQbgx3pSLMgZT8bjtnctHqFePiHCOAI33CVw==',key_name='tempest-keypair-1702131576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-0lchui8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=396feab9-f7a6-4983-aaa9-59eb99677740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:e4:c2,bridge_name='br-int',has_traffic_filtering=True,id=f5c79a0e-cb9c-40a0-ba5e-95d9f6050906,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c79a0e-cb') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG os_vif [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:e4:c2,bridge_name='br-int',has_traffic_filtering=True,id=f5c79a0e-cb9c-40a0-ba5e-95d9f6050906,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c79a0e-cb') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '681f1566-9732-5773-8738-e88ca2344efa', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5c79a0e-cb, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5c79a0e-cb, col_values=(('qos', UUID('dd74fd29-38f3-41c7-b194-c7837c81e04b')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5c79a0e-cb, col_values=(('external_ids', {'iface-id': 'f5c79a0e-cb9c-40a0-ba5e-95d9f6050906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:e4:c2', 'vm-uuid': '396feab9-f7a6-4983-aaa9-59eb99677740'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:52 user nova-compute[76391]: INFO os_vif [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:e4:c2,bridge_name='br-int',has_traffic_filtering=True,id=f5c79a0e-cb9c-40a0-ba5e-95d9f6050906,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c79a0e-cb')
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No VIF found with MAC fa:16:3e:40:e4:c2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updated VIF entry in instance network info cache for port f5c79a0e-cb9c-40a0-ba5e-95d9f6050906. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updating instance_info_cache with network_info: [{"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:40:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e781d71b-b04e-4f22-a778-e46212dc6fc6 req-e094e52d-8099-400b-9fd2-4b0cb6d30f41 service nova] Releasing lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:40:53 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Instance spawned successfully.
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:53 user nova-compute[76391]: INFO nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-287b67c4-8f5c-4db6-96bd-cb4315b01c81 req-a72c50f6-8bd7-43a2-b01c-c94b84d9b1b6 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-287b67c4-8f5c-4db6-96bd-cb4315b01c81 req-a72c50f6-8bd7-43a2-b01c-c94b84d9b1b6 service nova] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-287b67c4-8f5c-4db6-96bd-cb4315b01c81 req-a72c50f6-8bd7-43a2-b01c-c94b84d9b1b6 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-287b67c4-8f5c-4db6-96bd-cb4315b01c81 req-a72c50f6-8bd7-43a2-b01c-c94b84d9b1b6 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-287b67c4-8f5c-4db6-96bd-cb4315b01c81 req-a72c50f6-8bd7-43a2-b01c-c94b84d9b1b6 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] No waiting events found dispatching network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:40:53 user nova-compute[76391]: WARNING nova.compute.manager [req-287b67c4-8f5c-4db6-96bd-cb4315b01c81 req-a72c50f6-8bd7-43a2-b01c-c94b84d9b1b6 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received unexpected event network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de for instance with vm_state building and task_state spawning.
Nov 15 23:40:53 user nova-compute[76391]: INFO nova.compute.manager [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Took 10.89 seconds to build instance.
Nov 15 23:40:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a9462f31-ee50-4d25-95c0-442e154e44aa tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.993s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] No waiting events found dispatching network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:40:55 user nova-compute[76391]: WARNING nova.compute.manager [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received unexpected event network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 for instance with vm_state building and task_state spawning.
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] No waiting events found dispatching network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:40:55 user nova-compute[76391]: WARNING nova.compute.manager [req-e50dc192-9569-4c8e-b2de-9ef0c58aade0 req-37c63efa-fc9c-4e0f-92ae-eb937c63b3d9 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received unexpected event network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 for instance with vm_state building and task_state spawning.
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:40:55 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Instance spawned successfully.
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:40:55 user nova-compute[76391]: INFO nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 15 23:40:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:40:55 user nova-compute[76391]: INFO nova.compute.manager [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Took 6.19 seconds to build instance.
Nov 15 23:40:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c4af1fab-2786-46a9-b8c1-800873636ecb tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.288s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:40:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:40:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:41:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:41:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:41:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:41:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:41:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:41:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:41:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:41:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:41:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:41:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 is timed out.
Nov 15 23:41:12 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config.
Nov 15 23:41:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiBtDyfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:41:12 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc418d38-0584-420d-8ac8-905436feb665]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:41:12 user nova-compute[76391]: No targets found.
Nov 15 23:41:12 user nova-compute[76391]: iSNS:
Nov 15 23:41:12 user nova-compute[76391]: No targets found.
Nov 15 23:41:12 user nova-compute[76391]: STATIC:
Nov 15 23:41:12 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:41:12 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:41:12 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:41:12 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026
Nov 15 23:41:12 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:41:12 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:41:12 user nova-compute[76391]: FIRMWARE:
Nov 15 23:41:12 user nova-compute[76391]: No targets found.
Nov 15 23:41:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:41:12 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:41:12 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a2466d-0e86-46b1-ae80-95d416b6ce88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[976551d3-5d75-483e-b80c-815517a195cb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:41:12 user nova-compute[76391]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 (non-flash)
Nov 15 23:41:12 user nova-compute[76391]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740351fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c3d7f-0133-4ff4-9fe6-437e1d231ab1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aded5c-59a4-4b0b-ac73-bfa3e692db51]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[007723f8-700f-462b-91a4-479bde6fdf19]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0862a9-0f72-4ab7-8b19-c07393346caa]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abe4d61-b5e2-4da6-a853-dcb719b74218]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed8f2d2-1456-4d5e-818e-136dcf29c334]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260]
Nov 15 23:41:12 user nova-compute[76391]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026, portal: 172.16.0.220,3260] successful.
Nov 15 23:41:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b731c5e-a5c9-4f35-8197-5b91239f9026 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe4a8f-df34-428d-ac75-10ab1bbcbff5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== disconnect_volume: return (289ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:41:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:41:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:41:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e7546ca0-83d7-48f1-86be-22829708ebc3 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.710s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:32 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:33 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:41:33 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8322MB free_disk=24.90228271484375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance f66fbb3a-6f83-4792-b171-ebd6ba021540 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 19794d53-9572-436b-b2b5-cdd2c7d342bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 396feab9-f7a6-4983-aaa9-59eb99677740 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:41:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:41:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:41:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:41:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:41:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:43 user nova-compute[76391]: INFO nova.compute.manager [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attaching volume 2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 to /dev/vdb
Nov 15 23:41:43 user nova-compute[76391]: DEBUG os_brick.utils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6259bc93-4125-4c09-8f6c-6ae4865df360]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a730a7c-6240-49e8-9811-af4a47951f0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[257a1cbf-0c9a-410e-bfc7-26a4955f7c30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd87638-e0c6-49bb-8da8-3442e424dcbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:41:43 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:41:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08565aeb-692f-4286-8407-391defe7df34]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG os_brick.utils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:41:43 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating existing volume attachment record: 9aa7bb65-6ae2-4a36-8561-fd3f95832df9 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:41:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFhIDtqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:41:48 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:41:48 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:41:48 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc82879-6059-4119-b641-f3cc64b81852]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:41:48 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3526f960-d581-42d5-b3a1-f9d1d2ac8fe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5] added
Nov 15 23:41:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c1e8dc-8ce6-49c2-8f6d-ddd82a4c1e52]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6764b796-2c8e-41a0-b9a1-3140468714b4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFhIDtqQ {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFhIDtqQ" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a79f5cc-87e7-424f-b5a5-3aa5e504f818]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JFhIDtqQ'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0bd0b3-529b-4675-9b1d-c2a16b4b60b0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be9862-ba08-44d8-9db4-62cbd9624923]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5766b902-c2e5-45bd-9c61-885f54b15fcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260]
Nov 15 23:41:48 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260] successful.
Nov 15 23:41:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad61965f-3f19-4de6-8624-afcc3df0ee86]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e8d52-e106-46db-8fc8-d3885fd85530]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:48 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:41:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:48 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:41:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dca64a-9f65-4b54-964d-afa4560ae411]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFhIDtqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23361373762343536', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361373762343536', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:41:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:41:49 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:41:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:41:49 user nova-compute[76391]:   <serial>2c1b8d31-41f6-44c7-8279-e7f0ce5265e5</serial>
Nov 15 23:41:49 user nova-compute[76391]: </disk>
Nov 15 23:41:49 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:41:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No VIF found with MAC fa:16:3e:9c:54:a2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid f66fbb3a-6f83-4792-b171-ebd6ba021540 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 19794d53-9572-436b-b2b5-cdd2c7d342bb {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b85be0d4-aa50-408a-99c7-92d868472f3f tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.537s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.048s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-changed-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.compute.manager [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Refreshing instance network info cache due to event network-changed-b180fa3a-5c39-4f30-892e-793585c248ec. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] Acquiring lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] Acquired lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:41:50 user nova-compute[76391]: DEBUG nova.network.neutron [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Refreshing network info cache for port b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updated VIF entry in instance network info cache for port b180fa3a-5c39-4f30-892e-793585c248ec. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updating instance_info_cache with network_info: [{"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9d4139bd-c13e-47ce-9ea1-f503a3253df2 req-970a5bbc-c5a3-4bd0-adea-9c775096a0b1 service nova] Releasing lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG nova.objects.instance [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'flavor' on Instance uuid f66fbb3a-6f83-4792-b171-ebd6ba021540 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:51 user nova-compute[76391]: INFO nova.compute.manager [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Attaching volume 7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 to /dev/vdb
Nov 15 23:41:51 user nova-compute[76391]: DEBUG os_brick.utils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a21707-da4c-4943-9c5d-e2a4a7a7de3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc760034-43a8-431e-976e-3a9d31172c97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65974765-6290-4ed2-a39c-5233c8b38596]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4256f7d9-5412-4b99-9245-921e6c20ed99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:41:51 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:41:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6caeb-08ae-4f23-9290-c609118e945a]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG os_brick.utils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:41:51 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updating existing volume attachment record: c4eb1a80-58cd-4674-b434-2e1027c4bb0d {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:41:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:41:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:41:52 user nova-compute[76391]: INFO nova.compute.manager [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Detaching volume 2c1b8d31-41f6-44c7-8279-e7f0ce5265e5
Nov 15 23:41:52 user nova-compute[76391]: INFO nova.virt.block_device [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attempting to driver detach volume 2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 from mountpoint /dev/vdb
Nov 15 23:41:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Attempting to detach device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:41:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:41:52 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:41:52 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:41:52 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:41:52 user nova-compute[76391]:   <serial>2c1b8d31-41f6-44c7-8279-e7f0ce5265e5</serial>
Nov 15 23:41:52 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:41:52 user nova-compute[76391]: </disk>
Nov 15 23:41:52 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:41:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config.
Nov 15 23:41:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:41:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:41:52 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:41:52 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:41:52 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:41:52 user nova-compute[76391]:   <serial>2c1b8d31-41f6-44c7-8279-e7f0ce5265e5</serial>
Nov 15 23:41:52 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:41:52 user nova-compute[76391]: </disk>
Nov 15 23:41:52 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:41:53 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abBFiLQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:41:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:41:56 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:41:56 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1339fafe-7246-42e9-92f5-cbdab202605b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:41:56 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901f4dd-2506-4204-abb2-0e0b858f8780]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96] added
Nov 15 23:41:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab67a30-cf75-49ad-bf6e-53848508f689]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f755b0d6-cf44-4201-8430-0912213bcf74]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abBFiLQA {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abBFiLQA" returned: 0 in 0.058s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[797aab6b-4d9f-41bb-a6a4-f3e11370363d]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abBFiLQA'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d965dbd3-6f4a-40d3-a699-3aeb27f942a1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a579a6b6-3671-40f9-a60a-828ea60f74f4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:56 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:41:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:56 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:41:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ad041-cee2-4582-bcc7-dad686c6dbe1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260]
Nov 15 23:41:56 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260] successful.
Nov 15 23:41:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae096ae7-d66b-4728-aa5b-303da1b4e780]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16508ed-831c-4aef-9f80-d1ecd4fbedc6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:56 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:41:56 user nova-compute[76391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)
Nov 15 23:41:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:41:56 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:41:56 user nova-compute[76391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)
Nov 15 23:41:56 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3743ddf0-3c47-4973-b843-79fc3074fea7]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:41:56 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abBFiLQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23864313038363836', 'path': '/dev/sdd'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864313038363836', 'path': '/dev/sdd'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG nova.objects.instance [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'flavor' on Instance uuid f66fbb3a-6f83-4792-b171-ebd6ba021540 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:41:57 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:41:57 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:41:57 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:41:57 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:41:57 user nova-compute[76391]:   <serial>7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96</serial>
Nov 15 23:41:57 user nova-compute[76391]: </disk>
Nov 15 23:41:57 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:41:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:41:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:41:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] No VIF found with MAC fa:16:3e:14:bd:d8, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:41:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3ae06c83-ffee-4ce6-9332-08504df9f31b tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.764s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:41:59 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:00 user nova-compute[76391]: INFO nova.compute.manager [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Detaching volume 7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96
Nov 15 23:42:00 user nova-compute[76391]: INFO nova.virt.block_device [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Attempting to driver detach volume 7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 from mountpoint /dev/vdb
Nov 15 23:42:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Attempting to detach device vdb from instance f66fbb3a-6f83-4792-b171-ebd6ba021540 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:42:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:42:00 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:00 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:42:00 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:42:00 user nova-compute[76391]:   <serial>7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96</serial>
Nov 15 23:42:00 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:42:00 user nova-compute[76391]: </disk>
Nov 15 23:42:00 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:42:00 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully detached device vdb from instance f66fbb3a-6f83-4792-b171-ebd6ba021540 from the persistent domain config.
Nov 15 23:42:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f66fbb3a-6f83-4792-b171-ebd6ba021540 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:42:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:42:00 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:00 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:42:00 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:42:00 user nova-compute[76391]:   <serial>7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96</serial>
Nov 15 23:42:00 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:42:00 user nova-compute[76391]: </disk>
Nov 15 23:42:00 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:42:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f66fbb3a-6f83-4792-b171-ebd6ba021540 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:42:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:42:13 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 is timed out.
Nov 15 23:42:13 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config.
Nov 15 23:42:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFhIDtqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:13 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c270617b-0d6c-43b3-8173-28ac8e861e6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:42:13 user nova-compute[76391]: No targets found.
Nov 15 23:42:13 user nova-compute[76391]: iSNS:
Nov 15 23:42:13 user nova-compute[76391]: No targets found.
Nov 15 23:42:13 user nova-compute[76391]: STATIC:
Nov 15 23:42:13 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5
Nov 15 23:42:13 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:42:13 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:42:13 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:42:13 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:42:13 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:42:13 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96
Nov 15 23:42:13 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:42:13 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:42:13 user nova-compute[76391]: FIRMWARE:
Nov 15 23:42:13 user nova-compute[76391]: No targets found.
Nov 15 23:42:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:42:13 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:42:13 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36156193-dba8-4694-8980-3e73911d3f5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbf6c34-d7c9-404d-9b14-2593db023a0c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:13 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:42:13 user nova-compute[76391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)
Nov 15 23:42:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:13 user nova-compute[76391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 (non-flash)
Nov 15 23:42:13 user nova-compute[76391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)
Nov 15 23:42:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97402f48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace6ecd5-157d-47b0-b834-fc83474e3c00]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f14c9b-07b9-4576-a577-cd4f9d83ff7a]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe0157-7e10-4bb0-b0de-a6b6098f367e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff9787-f68b-4b83-a31c-0bbfd1fcf62b]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff63a034-24c1-41e1-95ad-bf48f7739d41]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d4cf8-73fb-4c88-a99d-82bd4d4e94c7]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260]
Nov 15 23:42:13 user nova-compute[76391]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5, portal: 172.16.0.220,3260] successful.
Nov 15 23:42:13 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1b8d31-41f6-44c7-8279-e7f0ce5265e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8678b53-14d4-4a64-a19d-3cf6b004e6e6]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== disconnect_volume: return (337ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:42:14 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ac913ac0-3121-4dd4-9648-61be389b26a7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.634s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:42:20 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f66fbb3a-6f83-4792-b171-ebd6ba021540 is timed out.
Nov 15 23:42:20 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully detached device vdb from instance f66fbb3a-6f83-4792-b171-ebd6ba021540 from the live domain config.
Nov 15 23:42:20 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abBFiLQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:20 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec04ad8-b218-485c-9b51-2b14cb799ee7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:42:20 user nova-compute[76391]: No targets found.
Nov 15 23:42:20 user nova-compute[76391]: iSNS:
Nov 15 23:42:20 user nova-compute[76391]: No targets found.
Nov 15 23:42:20 user nova-compute[76391]: STATIC:
Nov 15 23:42:20 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:42:20 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:42:20 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:42:20 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96
Nov 15 23:42:20 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:42:20 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:42:20 user nova-compute[76391]: FIRMWARE:
Nov 15 23:42:20 user nova-compute[76391]: No targets found.
Nov 15 23:42:20 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:42:20 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:42:20 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ed89e-7fb1-4d7e-99e7-040e2a016450]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[746cce90-3d24-4c08-8b28-ed0864cf7928]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:20 user nova-compute[76391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)
Nov 15 23:42:20 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:20 user nova-compute[76391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 (non-flash)
Nov 15 23:42:20 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97600ece50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96'): ({'sdd'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Removing single pathed devices sdd {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65954716-ff87-4bc8-ab20-ca292621515d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:20 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82869f10-45f4-4633-a5d4-4f351e58187f]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Flushing IO for device /dev/sdd {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce8a742-88aa-47d9-a921-034837e08b92]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[657774a9-5ac9-4743-84cb-5874a65cbbdb]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f958aeca-4b71-425d-9e75-c00a4336eb21]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15476fa-a5a6-44fd-81b6-5b0bbef87659]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260]
Nov 15 23:42:21 user nova-compute[76391]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96, portal: 172.16.0.220,3260] successful.
Nov 15 23:42:21 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd9a48d-5dcb-4e83-bfac-3b50d7a12a96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdfd429-46c5-4b72-a537-45802c0d1031]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] <== disconnect_volume: return (278ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG nova.objects.instance [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'flavor' on Instance uuid f66fbb3a-6f83-4792-b171-ebd6ba021540 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:21 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-572333cf-3cd5-45ee-ae74-57fcc6bafd6d tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-changed-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Refreshing instance network info cache due to event network-changed-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] Acquiring lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] Acquired lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.network.neutron [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Refreshing network info cache for port cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:33 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updated VIF entry in instance network info cache for port cffe0d3c-a19c-4bd3-a559-55a9a2cee6de. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG nova.network.neutron [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updating instance_info_cache with network_info: [{"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4910b547-7901-4a62-8d68-29a2c0d08e68 req-cae7a3e3-15f9-43c8-bdd9-3faff7b5b879 service nova] Releasing lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:34 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:36 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:42:36 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=24.900592803955078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance f66fbb3a-6f83-4792-b171-ebd6ba021540 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 19794d53-9572-436b-b2b5-cdd2c7d342bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 396feab9-f7a6-4983-aaa9-59eb99677740 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:42:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "d89773a1-53cd-467f-a7cf-fdd51166bfce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:42:39 user nova-compute[76391]: INFO nova.compute.claims [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Claim successful on node user
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:42:39 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:42:39 user nova-compute[76391]: DEBUG nova.policy [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8b2b277f69f480f8a2c102a46792247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b3dc7e25d24f309b8c4bb7be5ad0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:42:39 user nova-compute[76391]: INFO nova.virt.block_device [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Booting with volume snapshot 7b068e8e-9997-4e71-b9ee-28acdaad01e8 at /dev/vda
Nov 15 23:42:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-changed-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG nova.compute.manager [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Refreshing instance network info cache due to event network-changed-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] Acquiring lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] Acquired lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG nova.network.neutron [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Refreshing network info cache for port f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:42:40 user nova-compute[76391]: DEBUG nova.network.neutron [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Successfully created port: 08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG nova.network.neutron [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updated VIF entry in instance network info cache for port f5c79a0e-cb9c-40a0-ba5e-95d9f6050906. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG nova.network.neutron [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updating instance_info_cache with network_info: [{"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-4983df9b-e351-4a19-8b5d-40392440d49d req-25093cd9-88b0-4286-9691-984002373660 service nova] Releasing lock "refresh_cache-396feab9-f7a6-4983-aaa9-59eb99677740" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Successfully updated port: 08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquired lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-changed-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Refreshing instance network info cache due to event network-changed-08fa8f52-7192-4797-9cb2-b5df2499e983. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:42:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] Acquiring lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG nova.network.neutron [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG nova.network.neutron [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Updating instance_info_cache with network_info: [{"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Releasing lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Instance network_info: |[{"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] Acquired lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG nova.network.neutron [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Refreshing network info cache for port 08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG nova.network.neutron [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Updated VIF entry in instance network info cache for port 08fa8f52-7192-4797-9cb2-b5df2499e983. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG nova.network.neutron [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Updating instance_info_cache with network_info: [{"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-af9b460c-3cdc-49a4-9dad-3321829574cd req-aba1e1f1-901c-4659-81a9-594e82b1f3fc service nova] Releasing lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:43 user nova-compute[76391]: INFO nova.compute.manager [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Attaching volume bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 to /dev/vdb
Nov 15 23:42:43 user nova-compute[76391]: DEBUG os_brick.utils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[493509a5-ea18-409d-8cec-02e89cf3448a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea21cf7-6a91-40d7-af30-59dbf338acb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d0eb9-4096-4f77-bd9f-416e7416a3ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13bfd5c-920e-4249-b402-70ab01604af5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:43 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:42:43 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f97930-ccba-4632-bc77-93fecf0bf973]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG os_brick.utils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:43 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updating existing volume attachment record: 63456b3e-0940-42e4-81d5-5ed24f62bd5c {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:42:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:44 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:45 user nova-compute[76391]: INFO nova.compute.manager [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attaching volume 46f40331-9a3d-48af-bb0c-65818a77d3ee to /dev/vdb
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.utils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea32fc0-b824-492f-a79c-afa24d7f73cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d568ef10-1c67-4a33-aac0-130f38c514b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3b883c-525d-4c18-89da-eefee4772418]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d687d8-2bcc-4702-a37c-76d37d4a0459]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:45 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2df1b-42b7-4176-b01e-9ca1d5418fb8]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.utils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating existing volume attachment record: 258c10c5-5885-4086-a407-32cf756d26d8 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.utils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd1144-b7b4-40fe-a1b6-e6fd55480584]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c93055-240d-451d-8e00-249f4187601f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78f2c0c-e512-42bd-a10a-3eb7deaa52e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb62737-2945-4d5e-adb1-dfb5e884ddc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:45 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:42:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[554210cd-c5b2-4821-ba9c-a2edbf42e2ed]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG os_brick.utils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:45 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Updating existing volume attachment record: 87e43954-cbef-47ab-bd34-86aedde620c3 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:42:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNTgwnUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:48 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:48 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:48 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1cd7de-7c5f-4124-861d-f4a4349b5824]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:42:48 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e731d-1b32-4d15-a350-38f14dccab8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8] added
Nov 15 23:42:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff0ad82-abd5-4a03-9139-74c32039e022]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a2e2a8-859d-4537-ae11-59cd3be919a3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNTgwnUS {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNTgwnUS" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82957f5-b46d-4625-82fd-a58a9f779f8b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZNTgwnUS'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcdde85-b69c-4027-93de-bc3720457147]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d7c547-8d4e-44d1-b311-4f2b93256b0d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c916e2a-2779-4492-a5cc-c5ccd972c113]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260]
Nov 15 23:42:48 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260] successful.
Nov 15 23:42:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8a7f3-a4fd-414f-80f1-323501dcea15]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fdb069-f661-418e-83ea-e820a38194c2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:48 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:48 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:48 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf5cbc-8cbf-413a-8a7e-d9da2085861a]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:42:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNTgwnUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23963376234376135', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963376234376135', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:42:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:49 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:42:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:42:49 user nova-compute[76391]:   <serial>bcf0eb1a-296b-44dd-9afd-8a5460a1fde8</serial>
Nov 15 23:42:49 user nova-compute[76391]: </disk>
Nov 15 23:42:49 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPNktxYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:49 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:49 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:49 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:49 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:42:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8f781-26c8-4e8c-8b97-58d10bd127a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:42:50 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7969f6-02f2-4c82-87f6-cfb3c8ea9398]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee] added
Nov 15 23:42:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4249044d-778f-4b0d-ad35-3a8efc96295c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[618ff8aa-5cf3-4af6-be3a-ac8e4a7e6b66]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPNktxYH {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPNktxYH" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec43b0-0e9e-4a6d-84d9-e07c80ef9fc2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPNktxYH'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa7bffa-7ab6-4c50-9647-604c6b02ce35]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee66f945-f850-4782-921b-a33b061ef3c9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:50 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:50 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No VIF found with MAC fa:16:3e:40:e4:c2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abfb729-fdcb-49fe-8097-02cf96090ba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260]
Nov 15 23:42:50 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260] successful.
Nov 15 23:42:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e0b31-21ff-4197-b567-c6f9884933e3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f7658-9c10-4fb9-a87e-3e972a462ead]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:50 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:50 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:50 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:50 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9e685a-fe87-432a-ba81-daff23935f16]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPNktxYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-0b4569f8-06d7-43d1-a518-5f8651146189 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.833s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:42:50 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Creating image(s)
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Ensure instance console log exists: /opt/stack/data/nova/instances/d89773a1-53cd-467f-a7cf-fdd51166bfce/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Start _get_guest_xml network_info=[{"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T23:42:35Z,direct_url=<?>,disk_format='qcow2',id=913085ab-687b-4570-979d-8f0bd3c0ee4d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-674946671',owner='93b3dc7e25d24f309b8c4bb7be5ad0f2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T23:42:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmhIKpFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd89773a1-53cd-467f-a7cf-fdd51166bfce', 'attached_at': '', 'detached_at': '', 'volume_id': '22dfc9b7-99be-4156-afac-bac39f43f0ca', 'serial': '22dfc9b7-99be-4156-afac-bac39f43f0ca'}, 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '87e43954-cbef-47ab-bd34-86aedde620c3', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:42:50 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:42:50 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T23:42:35Z,direct_url=<?>,disk_format='qcow2',id=913085ab-687b-4570-979d-8f0bd3c0ee4d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-674946671',owner='93b3dc7e25d24f309b8c4bb7be5ad0f2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T23:42:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:42:50 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmhIKpFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:51 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-changed-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Refreshing instance network info cache due to event network-changed-b180fa3a-5c39-4f30-892e-793585c248ec. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] Acquiring lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] Acquired lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Refreshing network info cache for port b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23961626630633562', 'path': '/dev/sdd'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961626630633562', 'path': '/dev/sdd'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.308s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:51 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:51 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44de194a-1ef8-4d32-a7d7-5e60fb1d612c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:42:51 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:42:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:51 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:42:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:42:51 user nova-compute[76391]:   <serial>46f40331-9a3d-48af-bb0c-65818a77d3ee</serial>
Nov 15 23:42:51 user nova-compute[76391]: </disk>
Nov 15 23:42:51 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e55d967-d2e3-4449-a1c7-1e5c8480a80e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca] added
Nov 15 23:42:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8889f30-5866-4aa2-a192-f85b9a33158f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:51 user nova-compute[76391]: INFO nova.compute.manager [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Terminating instance
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[026783cf-79c9-4358-ba0d-0418f573de06]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmhIKpFe {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmhIKpFe" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2bce4c-8ad7-4371-b764-699fecd86675]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LmhIKpFe'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[361a858a-68a1-4943-82c3-574480cdd4bc]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5af712-c623-4f90-ac17-a54f3b1e29ce]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba3f651-6115-4cae-bffa-ed5d9710087c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260]
Nov 15 23:42:51 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260] successful.
Nov 15 23:42:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94022042-dd63-49e3-935f-d35ca4361e1a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f204760-9514-4912-8c10-8e110c4bc21f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:42:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:51 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:42:51 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] HCTL ('36', '-', '-', 0) found on session 58 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updated VIF entry in instance network info cache for port b180fa3a-5c39-4f30-892e-793585c248ec. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.network.neutron [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updating instance_info_cache with network_info: [{"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[432711e0-8590-44c5-8a7d-d6b571ee257b]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching for a device in session 58 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmhIKpFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-ec975119-7347-4f73-ac83-7b2671054e60 req-4a6a0a1b-2e0d-4b01-b070-0a59eb73e7bd service nova] Releasing lock "refresh_cache-f66fbb3a-6f83-4792-b171-ebd6ba021540" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] No VIF found with MAC fa:16:3e:9c:54:a2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fdd955ba-d376-4932-9d77-fe1dfa9477d7 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.901s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Instance destroyed successfully.
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'resources' on Instance uuid f66fbb3a-6f83-4792-b171-ebd6ba021540 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-536438635',display_name='tempest-TestStampPattern-server-536438635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-536438635',id=46,image_ref='ce5c8496-4a32-413e-afb3-3559eaf2ea0b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDDSQ6k1cWwyS4WEd+yxAmvqQBEiExgn9f0DCEC8t6J855pUVXshZfGp1Bp7GX0xD5JJvzuJe44aIByWAyKotYhrTJuqO0XXhT5W+g+6AFBTdITap7Mbj/L0/6KVkJDFQ==',key_name='tempest-TestStampPattern-1250583077',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:40:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14f84553fb9741ee9ce5b74fa602b637',ramdisk_id='',reservation_id='r-jl1n0cgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e482ec5d-8630-4d09-9100-aa9ac345ecb3',image_min_disk='1',image_min_ram='0',image_owner_id='14f84553fb9741ee9ce5b74fa602b637',image_owner_project_name='tempest-TestStampPattern-1891858582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1891858582-project-member',image_user_id='df069f99697e4424ac6c833251e9c47c',owner_project_name='tempest-TestStampPattern-1891858582',owner_user_name='tempest-TestStampPattern-1891858582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:40:06Z,user_data=None,user_id='df069f99697e4424ac6c833251e9c47c',uuid=f66fbb3a-6f83-4792-b171-ebd6ba021540,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converting VIF {"id": "b180fa3a-5c39-4f30-892e-793585c248ec", "address": "fa:16:3e:14:bd:d8", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb180fa3a-5c", "ovs_interfaceid": "b180fa3a-5c39-4f30-892e-793585c248ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:bd:d8,bridge_name='br-int',has_traffic_filtering=True,id=b180fa3a-5c39-4f30-892e-793585c248ec,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb180fa3a-5c') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG os_vif [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:bd:d8,bridge_name='br-int',has_traffic_filtering=True,id=b180fa3a-5c39-4f30-892e-793585c248ec,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb180fa3a-5c') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb180fa3a-5c, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84c5415d-b1fd-4faa-b508-7a2b2e8c5923) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:42:52 user nova-compute[76391]: INFO os_vif [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:bd:d8,bridge_name='br-int',has_traffic_filtering=True,id=b180fa3a-5c39-4f30-892e-793585c248ec,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb180fa3a-5c')
Nov 15 23:42:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Deleting instance files /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540_del
Nov 15 23:42:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Deletion of /opt/stack/data/nova/instances/f66fbb3a-6f83-4792-b171-ebd6ba021540_del complete
Nov 15 23:42:52 user nova-compute[76391]: INFO nova.compute.manager [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 23:42:52 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== connect_volume: return (1722ms) {'type': 'block', 'scsi_wwn': '26530393834396262', 'path': '/dev/sde'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530393834396262', 'path': '/dev/sde'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1680475757',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1680475757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1680475757',id=49,image_ref='913085ab-687b-4570-979d-8f0bd3c0ee4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL7UEo54Q9Z1prBPs4/SnsaGcg5Mh3SbuwyJxE64MKz/YtX83O/wqFPnuh3q0c+AhjUexg+03ZRRlCEJKqV4X/t7igZuXEpfWU6xECLkp2Lpy5oZFLZJnPlI/b02QMTpA==',key_name='tempest-keypair-1310557488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-tvo7ny1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1132666866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8b2b277f69f480f8a2c102a46792247',uuid=d89773a1-53cd-467f-a7cf-fdd51166bfce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=08fa8f52-7192-4797-9cb2-b5df2499e983,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fa8f52-71') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.objects.instance [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'pci_devices' on Instance uuid d89773a1-53cd-467f-a7cf-fdd51166bfce {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:42:52 user nova-compute[76391]:   <uuid>d89773a1-53cd-467f-a7cf-fdd51166bfce</uuid>
Nov 15 23:42:52 user nova-compute[76391]:   <name>instance-00000031</name>
Nov 15 23:42:52 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:42:52 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:42:52 user nova-compute[76391]:   <metadata>
Nov 15 23:42:52 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:42:52 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:42:52 user nova-compute[76391]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1680475757</nova:name>
Nov 15 23:42:52 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:42:50</nova:creationTime>
Nov 15 23:42:52 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:42:52 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:42:52 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:42:52 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:42:52 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:42:52 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:42:52 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:42:52 user nova-compute[76391]:       <nova:owner>
Nov 15 23:42:52 user nova-compute[76391]:         <nova:user uuid="b8b2b277f69f480f8a2c102a46792247">tempest-TestVolumeBootPattern-1132666866-project-member</nova:user>
Nov 15 23:42:52 user nova-compute[76391]:         <nova:project uuid="93b3dc7e25d24f309b8c4bb7be5ad0f2">tempest-TestVolumeBootPattern-1132666866</nova:project>
Nov 15 23:42:52 user nova-compute[76391]:       </nova:owner>
Nov 15 23:42:52 user nova-compute[76391]:       <nova:root type="image" uuid="913085ab-687b-4570-979d-8f0bd3c0ee4d"/>
Nov 15 23:42:52 user nova-compute[76391]:       <nova:ports>
Nov 15 23:42:52 user nova-compute[76391]:         <nova:port uuid="08fa8f52-7192-4797-9cb2-b5df2499e983">
Nov 15 23:42:52 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 23:42:52 user nova-compute[76391]:         </nova:port>
Nov 15 23:42:52 user nova-compute[76391]:       </nova:ports>
Nov 15 23:42:52 user nova-compute[76391]:     </nova:instance>
Nov 15 23:42:52 user nova-compute[76391]:   </metadata>
Nov 15 23:42:52 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:42:52 user nova-compute[76391]:     <system>
Nov 15 23:42:52 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:42:52 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:42:52 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:42:52 user nova-compute[76391]:       <entry name="serial">d89773a1-53cd-467f-a7cf-fdd51166bfce</entry>
Nov 15 23:42:52 user nova-compute[76391]:       <entry name="uuid">d89773a1-53cd-467f-a7cf-fdd51166bfce</entry>
Nov 15 23:42:52 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:42:52 user nova-compute[76391]:     </system>
Nov 15 23:42:52 user nova-compute[76391]:   </sysinfo>
Nov 15 23:42:52 user nova-compute[76391]:   <os>
Nov 15 23:42:52 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:42:52 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:42:52 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:42:52 user nova-compute[76391]:   </os>
Nov 15 23:42:52 user nova-compute[76391]:   <features>
Nov 15 23:42:52 user nova-compute[76391]:     <acpi/>
Nov 15 23:42:52 user nova-compute[76391]:     <apic/>
Nov 15 23:42:52 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:42:52 user nova-compute[76391]:   </features>
Nov 15 23:42:52 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:42:52 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:42:52 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:42:52 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:42:52 user nova-compute[76391]:   </clock>
Nov 15 23:42:52 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:42:52 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:42:52 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:42:52 user nova-compute[76391]:   </cpu>
Nov 15 23:42:52 user nova-compute[76391]:   <devices>
Nov 15 23:42:52 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:42:52 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:52 user nova-compute[76391]:       <source dev="/dev/sde"/>
Nov 15 23:42:52 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:42:52 user nova-compute[76391]:       <serial>22dfc9b7-99be-4156-afac-bac39f43f0ca</serial>
Nov 15 23:42:52 user nova-compute[76391]:     </disk>
Nov 15 23:42:52 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:42:52 user nova-compute[76391]:       <mac address="fa:16:3e:ec:9c:2f"/>
Nov 15 23:42:52 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:42:52 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:42:52 user nova-compute[76391]:       <target dev="tap08fa8f52-71"/>
Nov 15 23:42:52 user nova-compute[76391]:     </interface>
Nov 15 23:42:52 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:42:52 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/d89773a1-53cd-467f-a7cf-fdd51166bfce/console.log" append="off"/>
Nov 15 23:42:52 user nova-compute[76391]:     </serial>
Nov 15 23:42:52 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:42:52 user nova-compute[76391]:     <video>
Nov 15 23:42:52 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:42:52 user nova-compute[76391]:     </video>
Nov 15 23:42:52 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:42:52 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:42:52 user nova-compute[76391]:     </rng>
Nov 15 23:42:52 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:42:52 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:42:52 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:42:52 user nova-compute[76391]:     </memballoon>
Nov 15 23:42:52 user nova-compute[76391]:   </devices>
Nov 15 23:42:52 user nova-compute[76391]: </domain>
Nov 15 23:42:52 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1680475757',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1680475757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1680475757',id=49,image_ref='913085ab-687b-4570-979d-8f0bd3c0ee4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL7UEo54Q9Z1prBPs4/SnsaGcg5Mh3SbuwyJxE64MKz/YtX83O/wqFPnuh3q0c+AhjUexg+03ZRRlCEJKqV4X/t7igZuXEpfWU6xECLkp2Lpy5oZFLZJnPlI/b02QMTpA==',key_name='tempest-keypair-1310557488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-tvo7ny1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1132666866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8b2b277f69f480f8a2c102a46792247',uuid=d89773a1-53cd-467f-a7cf-fdd51166bfce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=08fa8f52-7192-4797-9cb2-b5df2499e983,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fa8f52-71') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG os_vif [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=08fa8f52-7192-4797-9cb2-b5df2499e983,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fa8f52-71') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ff91883-5550-5d71-a5b5-a105fab819e9', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08fa8f52-71, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08fa8f52-71, col_values=(('qos', UUID('06e8976c-4e97-40f0-8527-8e98e0e283f4')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08fa8f52-71, col_values=(('external_ids', {'iface-id': '08fa8f52-7192-4797-9cb2-b5df2499e983', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:9c:2f', 'vm-uuid': 'd89773a1-53cd-467f-a7cf-fdd51166bfce'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:52 user nova-compute[76391]: INFO os_vif [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=08fa8f52-7192-4797-9cb2-b5df2499e983,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fa8f52-71')
Nov 15 23:42:52 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Took 0.53 seconds to deallocate network for instance.
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b8f2c9a-b4d4-4621-b871-c9e66297b15c req-b5eb96b5-083c-4e8a-9809-ce0397d3d8e5 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-deleted-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:52 user nova-compute[76391]: INFO nova.compute.manager [req-9b8f2c9a-b4d4-4621-b871-c9e66297b15c req-b5eb96b5-083c-4e8a-9809-ce0397d3d8e5 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Neutron deleted interface b180fa3a-5c39-4f30-892e-793585c248ec; detaching it from the instance and deleting it from the info cache
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.network.neutron [req-9b8f2c9a-b4d4-4621-b871-c9e66297b15c req-b5eb96b5-083c-4e8a-9809-ce0397d3d8e5 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.compute.manager [req-9b8f2c9a-b4d4-4621-b871-c9e66297b15c req-b5eb96b5-083c-4e8a-9809-ce0397d3d8e5 service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Detach interface failed, port_id=b180fa3a-5c39-4f30-892e-793585c248ec, reason: Instance f66fbb3a-6f83-4792-b171-ebd6ba021540 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:42:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No VIF found with MAC fa:16:3e:ec:9c:2f, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Deleted allocations for instance f66fbb3a-6f83-4792-b171-ebd6ba021540
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d979c1de-72b6-42a7-9da9-ba6b0abd247f tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.851s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-unplugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-unplugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:53 user nova-compute[76391]: WARNING nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-unplugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state deleted and task_state None.
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:53 user nova-compute[76391]: WARNING nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state deleted and task_state None.
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:53 user nova-compute[76391]: WARNING nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state deleted and task_state None.
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:53 user nova-compute[76391]: WARNING nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state deleted and task_state None.
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-unplugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-unplugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:53 user nova-compute[76391]: WARNING nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-unplugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state deleted and task_state None.
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Acquiring lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] Lock "f66fbb3a-6f83-4792-b171-ebd6ba021540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] No waiting events found dispatching network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:53 user nova-compute[76391]: WARNING nova.compute.manager [req-96970aa3-3954-4923-909a-c4491f0fff7f req-fc8c93e5-5f19-449f-9c5a-09b89110bc2e service nova] [instance: f66fbb3a-6f83-4792-b171-ebd6ba021540] Received unexpected event network-vif-plugged-b180fa3a-5c39-4f30-892e-793585c248ec for instance with vm_state deleted and task_state None.
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:53 user nova-compute[76391]: INFO nova.compute.manager [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Attaching volume b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 to /dev/vdc
Nov 15 23:42:53 user nova-compute[76391]: DEBUG os_brick.utils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83816b-e8fa-4a9b-97a2-2d0619383355]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ea7a0-a142-483d-9e79-cbb1129fc181]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69151417-9b17-4139-a041-7f64865b32a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519d8ca-84ef-4441-aac6-a401e2c8daf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:42:53 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:42:53 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c918d8c2-82e3-4e7f-a34b-0b069e0b4044]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG os_brick.utils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:53 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updating existing volume attachment record: cb78f6c3-395e-4b12-87a9-b3289a98b918 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:54 user nova-compute[76391]: INFO nova.compute.manager [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Detaching volume 46f40331-9a3d-48af-bb0c-65818a77d3ee
Nov 15 23:42:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:54 user nova-compute[76391]: INFO nova.virt.block_device [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Attempting to driver detach volume 46f40331-9a3d-48af-bb0c-65818a77d3ee from mountpoint /dev/vdb
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Attempting to detach device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:42:54 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:54 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:42:54 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:42:54 user nova-compute[76391]:   <serial>46f40331-9a3d-48af-bb0c-65818a77d3ee</serial>
Nov 15 23:42:54 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:42:54 user nova-compute[76391]: </disk>
Nov 15 23:42:54 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:42:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the persistent domain config.
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:42:54 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:54 user nova-compute[76391]:   <source dev="/dev/sdd"/>
Nov 15 23:42:54 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:42:54 user nova-compute[76391]:   <serial>46f40331-9a3d-48af-bb0c-65818a77d3ee</serial>
Nov 15 23:42:54 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:42:54 user nova-compute[76391]: </disk>
Nov 15 23:42:54 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] Acquiring lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] No waiting events found dispatching network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:54 user nova-compute[76391]: WARNING nova.compute.manager [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received unexpected event network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 for instance with vm_state building and task_state spawning.
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] Acquiring lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:54 user nova-compute[76391]: DEBUG nova.compute.manager [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] No waiting events found dispatching network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:42:54 user nova-compute[76391]: WARNING nova.compute.manager [req-f6ce3b5c-8dcc-4a60-ad6c-d10dc283186b req-8fcc4e8d-9614-47f5-bb87-1a64c9a2a37c service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received unexpected event network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 for instance with vm_state building and task_state spawning.
Nov 15 23:42:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:42:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:42:56 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Instance spawned successfully.
Nov 15 23:42:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:42:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:42:56 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:42:56 user nova-compute[76391]: INFO nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 15 23:42:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:42:56 user nova-compute[76391]: INFO nova.compute.manager [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Took 17.48 seconds to build instance.
Nov 15 23:42:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-bb71a885-8abb-42af-9e88-9d061581d135 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.573s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:42:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAvCcgEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:42:58 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:58 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:42:58 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c7c0d-1308-4980-919f-348d6c73b8bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:42:58 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfec78f-3b23-4726-8736-458dad7191b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764] added
Nov 15 23:42:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe6847-d6df-40cb-88a7-58a4805d1f9c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58c0fff-36c2-4de9-8f63-c6ad32514684]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAvCcgEi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAvCcgEi" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ed9413-a42b-4f90-8e0f-6e697d1c9b33]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qAvCcgEi'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50858865-38aa-4438-be21-17914540eb1e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe9a8b8-dbbb-4a14-8e37-d59ec1bcbf7f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:42:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:42:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d3846a-9b40-425f-af70-81100993ea10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260]
Nov 15 23:42:58 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260] successful.
Nov 15 23:42:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96113d4-2828-40f2-a938-25e14263d1ca]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bbf2aa-c8d8-4ca6-b6d4-6ed21c102ca4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:42:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:42:58 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:42:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] HCTL ('37', '-', '-', 0) found on session 59 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52234add-c64e-41ba-8e5d-cc35225cd1f9]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Searching for a device in session 59 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:42:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAvCcgEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:42:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:42:59 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26437356130396133', 'path': '/dev/sdf'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:42:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437356130396133', 'path': '/dev/sdf'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:42:59 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:42:59 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:42:59 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:42:59 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:42:59 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:42:59 user nova-compute[76391]:   <serial>b50cdfbf-bd0d-4923-876a-5b2bd0ab5764</serial>
Nov 15 23:42:59 user nova-compute[76391]: </disk>
Nov 15 23:42:59 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:43:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:43:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:43:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:43:00 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] No VIF found with MAC fa:16:3e:40:e4:c2, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:43:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2fcecf84-3ab6-4b2a-a25d-984cd28bcc17 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.353s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:01 user nova-compute[76391]: INFO nova.compute.manager [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Detaching volume bcf0eb1a-296b-44dd-9afd-8a5460a1fde8
Nov 15 23:43:01 user nova-compute[76391]: INFO nova.virt.block_device [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Attempting to driver detach volume bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 from mountpoint /dev/vdb
Nov 15 23:43:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Attempting to detach device vdb from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:43:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:43:01 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:43:01 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:43:01 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:43:01 user nova-compute[76391]:   <serial>bcf0eb1a-296b-44dd-9afd-8a5460a1fde8</serial>
Nov 15 23:43:01 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:43:01 user nova-compute[76391]: </disk>
Nov 15 23:43:01 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:43:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully detached device vdb from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the persistent domain config.
Nov 15 23:43:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:43:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:43:01 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:43:01 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:43:01 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:43:01 user nova-compute[76391]:   <serial>bcf0eb1a-296b-44dd-9afd-8a5460a1fde8</serial>
Nov 15 23:43:01 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:43:01 user nova-compute[76391]: </disk>
Nov 15 23:43:01 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:43:02 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:43:02 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:07 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:14 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 is timed out.
Nov 15 23:43:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully detached device vdb from instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 from the live domain config.
Nov 15 23:43:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPNktxYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:43:14 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ca040-e66d-486c-8cc3-6badfe0d42dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:43:14 user nova-compute[76391]: No targets found.
Nov 15 23:43:14 user nova-compute[76391]: iSNS:
Nov 15 23:43:14 user nova-compute[76391]: No targets found.
Nov 15 23:43:14 user nova-compute[76391]: STATIC:
Nov 15 23:43:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:43:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764
Nov 15 23:43:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca
Nov 15 23:43:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee
Nov 15 23:43:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8
Nov 15 23:43:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:14 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:14 user nova-compute[76391]: FIRMWARE:
Nov 15 23:43:14 user nova-compute[76391]: No targets found.
Nov 15 23:43:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:43:14 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:43:14 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b566575c-2a2d-4cf9-be09-b61073ec8da1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[816ab60d-2ad4-4da3-a14d-d399d11540f6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:43:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:43:14 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:43:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976d4df910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee'): ({'sdd'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Removing single pathed devices sdd {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a4838-dbfe-4004-950d-1c7c85f522cf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[456ae396-897d-44e4-b123-19440e8614c8]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Flushing IO for device /dev/sdd {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c099e83-d2c8-4dea-b740-be2cd5802deb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddb8972-a197-4aa3-8b08-f7d6cd4464fd]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] SCSI volumes sdd have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5febaa-86fd-4767-87f5-8068c20edbbb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40005f0e-4fcc-4ce2-9781-8f226fd1bce4]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260]
Nov 15 23:43:15 user nova-compute[76391]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee, portal: 172.16.0.220,3260] successful.
Nov 15 23:43:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f40331-9a3d-48af-bb0c-65818a77d3ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a4b56f-4747-40e0-a329-d297fa4bbba4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] <== disconnect_volume: return (325ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:43:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'flavor' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:43:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-27afcbcf-472e-42fa-8155-18b14be2feb2 tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:17 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:22 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 396feab9-f7a6-4983-aaa9-59eb99677740 is timed out.
Nov 15 23:43:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully detached device vdb from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the live domain config.
Nov 15 23:43:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNTgwnUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:43:22 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebed4d98-5975-42fd-a464-cab4162ad994]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:43:22 user nova-compute[76391]: No targets found.
Nov 15 23:43:22 user nova-compute[76391]: iSNS:
Nov 15 23:43:22 user nova-compute[76391]: No targets found.
Nov 15 23:43:22 user nova-compute[76391]: STATIC:
Nov 15 23:43:22 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:43:22 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:22 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:22 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764
Nov 15 23:43:22 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:22 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:22 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca
Nov 15 23:43:22 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:22 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:22 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8
Nov 15 23:43:22 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:22 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:22 user nova-compute[76391]: FIRMWARE:
Nov 15 23:43:22 user nova-compute[76391]: No targets found.
Nov 15 23:43:22 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:43:22 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:43:22 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e05ef8-5632-41b8-b497-12bc260cece7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d010c756-ab1c-42a0-965b-291488e87364]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:43:22 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:43:22 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:43:22 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:43:22 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:43:22 user nova-compute[76391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 (non-flash)
Nov 15 23:43:22 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:43:22 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:43:22 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405cab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[536fa7aa-26bc-40cf-a2fe-8012ee70b457]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3302954c-a937-433b-94f2-c8de92617aa5]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1195cf36-830b-4d80-9653-edcd32ec67fb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4db1d54-8bc2-4a66-a760-7bcfd58121f7]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20b18b-2265-439e-890e-6186f76f40e2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cdad08-6146-44d2-b6b7-a1ade9f6e396]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260]
Nov 15 23:43:22 user nova-compute[76391]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8, portal: 172.16.0.220,3260] successful.
Nov 15 23:43:22 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf0eb1a-296b-44dd-9afd-8a5460a1fde8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11417b4b-45dc-4122-a4f3-7c2ef80c24a0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== disconnect_volume: return (288ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:43:22 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:23 user nova-compute[76391]: DEBUG nova.objects.instance [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:43:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-17d1751b-e9d6-4c51-8658-2ec6d5aec747 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.592s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:24 user nova-compute[76391]: INFO nova.compute.manager [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Detaching volume b50cdfbf-bd0d-4923-876a-5b2bd0ab5764
Nov 15 23:43:24 user nova-compute[76391]: INFO nova.virt.block_device [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Attempting to driver detach volume b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 from mountpoint /dev/vdc
Nov 15 23:43:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Attempting to detach device vdc from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:43:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:43:24 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:43:24 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:43:24 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:43:24 user nova-compute[76391]:   <serial>b50cdfbf-bd0d-4923-876a-5b2bd0ab5764</serial>
Nov 15 23:43:24 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 23:43:24 user nova-compute[76391]: </disk>
Nov 15 23:43:24 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:43:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully detached device vdc from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the persistent domain config.
Nov 15 23:43:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:43:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:43:24 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:43:24 user nova-compute[76391]:   <source dev="/dev/sdf"/>
Nov 15 23:43:24 user nova-compute[76391]:   <target dev="vdc" bus="virtio"/>
Nov 15 23:43:24 user nova-compute[76391]:   <serial>b50cdfbf-bd0d-4923-876a-5b2bd0ab5764</serial>
Nov 15 23:43:24 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 23:43:24 user nova-compute[76391]: </disk>
Nov 15 23:43:24 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:43:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:43:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:27 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:43:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:43:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:43:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:43:32 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating instance_info_cache with network_info: [{"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:43:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:43:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:36 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:37 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:43:37 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8377MB free_disk=24.890483856201172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 19794d53-9572-436b-b2b5-cdd2c7d342bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 396feab9-f7a6-4983-aaa9-59eb99677740 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance d89773a1-53cd-467f-a7cf-fdd51166bfce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:43:37 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:43:41 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:43:44 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 396feab9-f7a6-4983-aaa9-59eb99677740 is timed out.
Nov 15 23:43:44 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully detached device vdc from instance 396feab9-f7a6-4983-aaa9-59eb99677740 from the live domain config.
Nov 15 23:43:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAvCcgEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:43:44 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc0513f-cb5d-4825-8504-2b9f89f7c9ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:43:44 user nova-compute[76391]: No targets found.
Nov 15 23:43:44 user nova-compute[76391]: iSNS:
Nov 15 23:43:44 user nova-compute[76391]: No targets found.
Nov 15 23:43:44 user nova-compute[76391]: STATIC:
Nov 15 23:43:44 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:43:44 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:44 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:44 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764
Nov 15 23:43:44 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:44 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:44 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca
Nov 15 23:43:44 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:43:44 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:43:44 user nova-compute[76391]: FIRMWARE:
Nov 15 23:43:44 user nova-compute[76391]: No targets found.
Nov 15 23:43:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:43:44 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:43:44 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ca235-6603-45d6-8f25-97ed5acc07f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[938730fd-99fa-4bc5-b3a6-b893c9bc36e1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:43:44 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:43:44 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:43:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:43:44 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:43:44 user nova-compute[76391]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 (non-flash)
Nov 15 23:43:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405b4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764'): ({'sdf'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Removing single pathed devices sdf {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8174fb-4512-4423-8567-a3365f78b9f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[215b034c-104a-44ad-aa71-34c240308bae]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Flushing IO for device /dev/sdf {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c6a07a-7aad-408c-b2aa-a7c7c94fbc5c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b8278-6716-49fb-b1ef-afc5b527cc88]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] SCSI volumes sdf have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f749a9a7-42ab-424e-a44e-610c2cbf92cd]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ff096-8a72-4922-8e96-73bb7c8ff040]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260]
Nov 15 23:43:44 user nova-compute[76391]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764, portal: 172.16.0.220,3260] successful.
Nov 15 23:43:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b50cdfbf-bd0d-4923-876a-5b2bd0ab5764 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d1220-89a0-43ae-ba8c-03d7bdb8d40a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] <== disconnect_volume: return (329ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:43:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'flavor' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-40a1c3ad-26ed-4417-95c6-a70dd9fe9e4e tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.317s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-changed-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG nova.compute.manager [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Refreshing instance network info cache due to event network-changed-b24fb092-3bae-437b-83e0-e22811d79ecd. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] Acquiring lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] Acquired lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG nova.network.neutron [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Refreshing network info cache for port b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:47 user nova-compute[76391]: INFO nova.compute.manager [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Terminating instance
Nov 15 23:43:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:47 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updated VIF entry in instance network info cache for port b24fb092-3bae-437b-83e0-e22811d79ecd. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.network.neutron [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [{"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c806e6d2-f25a-4db1-af9f-81695271f400 req-e8d98998-f7a2-4ff7-9a01-cd62d18f9677 service nova] Releasing lock "refresh_cache-e482ec5d-8630-4d09-9100-aa9ac345ecb3" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:48 user nova-compute[76391]: INFO nova.compute.manager [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Terminating instance
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Instance destroyed successfully.
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.objects.instance [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lazy-loading 'resources' on Instance uuid e482ec5d-8630-4d09-9100-aa9ac345ecb3 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1790628828',display_name='tempest-TestStampPattern-server-1790628828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1790628828',id=43,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDDSQ6k1cWwyS4WEd+yxAmvqQBEiExgn9f0DCEC8t6J855pUVXshZfGp1Bp7GX0xD5JJvzuJe44aIByWAyKotYhrTJuqO0XXhT5W+g+6AFBTdITap7Mbj/L0/6KVkJDFQ==',key_name='tempest-TestStampPattern-1250583077',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:37:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14f84553fb9741ee9ce5b74fa602b637',ramdisk_id='',reservation_id='r-ft64vkel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1891858582',owner_user_name='tempest-TestStampPattern-1891858582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:39:57Z,user_data=None,user_id='df069f99697e4424ac6c833251e9c47c',uuid=e482ec5d-8630-4d09-9100-aa9ac345ecb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converting VIF {"id": "b24fb092-3bae-437b-83e0-e22811d79ecd", "address": "fa:16:3e:39:bd:b1", "network": {"id": "42fb23fa-9274-46d8-b487-5161a59eadb1", "bridge": "br-int", "label": "tempest-TestStampPattern-571856586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14f84553fb9741ee9ce5b74fa602b637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24fb092-3b", "ovs_interfaceid": "b24fb092-3bae-437b-83e0-e22811d79ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:bd:b1,bridge_name='br-int',has_traffic_filtering=True,id=b24fb092-3bae-437b-83e0-e22811d79ecd,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24fb092-3b') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG os_vif [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:bd:b1,bridge_name='br-int',has_traffic_filtering=True,id=b24fb092-3bae-437b-83e0-e22811d79ecd,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24fb092-3b') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb24fb092-3b, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99228dc4-2e1f-4abc-824f-7c05b24beefc) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:48 user nova-compute[76391]: INFO os_vif [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:bd:b1,bridge_name='br-int',has_traffic_filtering=True,id=b24fb092-3bae-437b-83e0-e22811d79ecd,network=Network(42fb23fa-9274-46d8-b487-5161a59eadb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24fb092-3b')
Nov 15 23:43:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Deleting instance files /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3_del
Nov 15 23:43:48 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Deletion of /opt/stack/data/nova/instances/e482ec5d-8630-4d09-9100-aa9ac345ecb3_del complete
Nov 15 23:43:48 user nova-compute[76391]: INFO nova.compute.manager [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 23:43:48 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:43:48 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:43:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Instance destroyed successfully.
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.objects.instance [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lazy-loading 'resources' on Instance uuid 396feab9-f7a6-4983-aaa9-59eb99677740 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1533543857',display_name='tempest-AttachVolumeTestJSON-server-1533543857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1533543857',id=48,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRsospcNw7YOB3v/aU38ZShy/HBnzK4N6d+nxnYUhzFKpCqSIMIx42VWxnqHCnF/s0+tUTuTe0dQxTOg2O4Fh1iI+xfvlqQbgx3pSLMgZT8bjtnctHqFePiHCOAI33CVw==',key_name='tempest-keypair-1702131576',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28f76509cb8a4588a018268eee3eb14a',ramdisk_id='',reservation_id='r-0lchui8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1495860226',owner_user_name='tempest-AttachVolumeTestJSON-1495860226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efa0b862a4e54967ba27a6cc88bb5496',uuid=396feab9-f7a6-4983-aaa9-59eb99677740,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converting VIF {"id": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "address": "fa:16:3e:40:e4:c2", "network": {"id": "21cfdd03-6260-413e-878d-3ecb98ee15dc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1115810455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28f76509cb8a4588a018268eee3eb14a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c79a0e-cb", "ovs_interfaceid": "f5c79a0e-cb9c-40a0-ba5e-95d9f6050906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:e4:c2,bridge_name='br-int',has_traffic_filtering=True,id=f5c79a0e-cb9c-40a0-ba5e-95d9f6050906,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c79a0e-cb') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG os_vif [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:e4:c2,bridge_name='br-int',has_traffic_filtering=True,id=f5c79a0e-cb9c-40a0-ba5e-95d9f6050906,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c79a0e-cb') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5c79a0e-cb, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd74fd29-38f3-41c7-b194-c7837c81e04b) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:49 user nova-compute[76391]: INFO os_vif [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:e4:c2,bridge_name='br-int',has_traffic_filtering=True,id=f5c79a0e-cb9c-40a0-ba5e-95d9f6050906,network=Network(21cfdd03-6260-413e-878d-3ecb98ee15dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c79a0e-cb')
Nov 15 23:43:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Deleting instance files /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740_del
Nov 15 23:43:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Deletion of /opt/stack/data/nova/instances/396feab9-f7a6-4983-aaa9-59eb99677740_del complete
Nov 15 23:43:49 user nova-compute[76391]: INFO nova.compute.manager [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:43:49 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Took 0.51 seconds to deallocate network for instance.
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-68b94e6f-4399-47bd-863a-77cf01ce21ea req-326cc88a-f12a-45e7-b943-4818f197d69a service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-vif-deleted-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:43:49 user nova-compute[76391]: INFO nova.compute.manager [req-68b94e6f-4399-47bd-863a-77cf01ce21ea req-326cc88a-f12a-45e7-b943-4818f197d69a service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Neutron deleted interface b24fb092-3bae-437b-83e0-e22811d79ecd; detaching it from the instance and deleting it from the info cache
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.network.neutron [req-68b94e6f-4399-47bd-863a-77cf01ce21ea req-326cc88a-f12a-45e7-b943-4818f197d69a service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-68b94e6f-4399-47bd-863a-77cf01ce21ea req-326cc88a-f12a-45e7-b943-4818f197d69a service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Detach interface failed, port_id=b24fb092-3bae-437b-83e0-e22811d79ecd, reason: Instance e482ec5d-8630-4d09-9100-aa9ac345ecb3 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:49 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Deleted allocations for instance e482ec5d-8630-4d09-9100-aa9ac345ecb3
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-vif-unplugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] No waiting events found dispatching network-vif-unplugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:43:49 user nova-compute[76391]: WARNING nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received unexpected event network-vif-unplugged-b24fb092-3bae-437b-83e0-e22811d79ecd for instance with vm_state deleted and task_state None.
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received event network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Acquiring lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] No waiting events found dispatching network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:43:49 user nova-compute[76391]: WARNING nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: e482ec5d-8630-4d09-9100-aa9ac345ecb3] Received unexpected event network-vif-plugged-b24fb092-3bae-437b-83e0-e22811d79ecd for instance with vm_state deleted and task_state None.
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-vif-unplugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] No waiting events found dispatching network-vif-unplugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-vif-unplugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Acquiring lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] Lock "396feab9-f7a6-4983-aaa9-59eb99677740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:49 user nova-compute[76391]: DEBUG nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] No waiting events found dispatching network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:43:49 user nova-compute[76391]: WARNING nova.compute.manager [req-9a385625-d47d-443e-9f70-358e22e7c569 req-5ca3a50c-8ccd-462b-821d-af861a958ab0 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received unexpected event network-vif-plugged-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 for instance with vm_state active and task_state deleting.
Nov 15 23:43:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-5afcda3f-c4ed-4e1b-8783-67682395342e tempest-TestStampPattern-1891858582 tempest-TestStampPattern-1891858582-project-member] Lock "e482ec5d-8630-4d09-9100-aa9ac345ecb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:50 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:43:50 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Took 0.97 seconds to deallocate network for instance.
Nov 15 23:43:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:43:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:43:50 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:43:50 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:43:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:50 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Deleted allocations for instance 396feab9-f7a6-4983-aaa9-59eb99677740
Nov 15 23:43:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-71b81bfd-84a0-4cbc-89b8-218945e842f4 tempest-AttachVolumeTestJSON-1495860226 tempest-AttachVolumeTestJSON-1495860226-project-member] Lock "396feab9-f7a6-4983-aaa9-59eb99677740" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:43:51 user nova-compute[76391]: DEBUG nova.compute.manager [req-6097087c-29f7-4e85-a9b6-5b9a022322dd req-ba37eb6e-3992-4eb1-98d9-379784dd10e8 service nova] [instance: 396feab9-f7a6-4983-aaa9-59eb99677740] Received event network-vif-deleted-f5c79a0e-cb9c-40a0-ba5e-95d9f6050906 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:43:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:43:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:43:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:00 user nova-compute[76391]: INFO nova.compute.manager [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Terminating instance
Nov 15 23:44:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-bf53db74-91ee-46a7-9c00-666c52e478d5 req-ec7c27f2-f757-4aaf-845d-5b276bf86899 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-vif-unplugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bf53db74-91ee-46a7-9c00-666c52e478d5 req-ec7c27f2-f757-4aaf-845d-5b276bf86899 service nova] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bf53db74-91ee-46a7-9c00-666c52e478d5 req-ec7c27f2-f757-4aaf-845d-5b276bf86899 service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-bf53db74-91ee-46a7-9c00-666c52e478d5 req-ec7c27f2-f757-4aaf-845d-5b276bf86899 service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-bf53db74-91ee-46a7-9c00-666c52e478d5 req-ec7c27f2-f757-4aaf-845d-5b276bf86899 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] No waiting events found dispatching network-vif-unplugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:44:00 user nova-compute[76391]: DEBUG nova.compute.manager [req-bf53db74-91ee-46a7-9c00-666c52e478d5 req-ec7c27f2-f757-4aaf-845d-5b276bf86899 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-vif-unplugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Instance destroyed successfully.
Nov 15 23:44:01 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lazy-loading 'resources' on Instance uuid 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:37:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1449916738',display_name='tempest-SnapshotDataIntegrityTests-server-1449916738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1449916738',id=44,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk340Dle+QdOpifZuCA2qGaw5hyan3DHw8f9CmT9xOl34D/oX3lsBrX+fCp6SOYIG0W97xI4YCSkDH3jEnCSwFfA2GoKkb1IAmlxeGVE4J2VIAEPOxDNGaMgFyfQas7gg==',key_name='tempest-keypair-1896054919',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:37:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a89d6c211b64177ac826eafc074046e',ramdisk_id='',reservation_id='r-7vrr44cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1887883826',owner_user_name='tempest-SnapshotDataIntegrityTests-1887883826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='021a4c49075349408c8453ea4caef8cc',uuid=6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Converting VIF {"id": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "address": "fa:16:3e:9c:54:a2", "network": {"id": "db298d76-06d0-47c2-9b64-87949505d17c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-504521226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a89d6c211b64177ac826eafc074046e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1e4d26-0a", "ovs_interfaceid": "cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:54:a2,bridge_name='br-int',has_traffic_filtering=True,id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1,network=Network(db298d76-06d0-47c2-9b64-87949505d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1e4d26-0a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG os_vif [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:54:a2,bridge_name='br-int',has_traffic_filtering=True,id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1,network=Network(db298d76-06d0-47c2-9b64-87949505d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1e4d26-0a') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd1e4d26-0a, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e52b7b61-c9ce-44ed-9820-3d9d87ff75fd) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:01 user nova-compute[76391]: INFO os_vif [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:54:a2,bridge_name='br-int',has_traffic_filtering=True,id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1,network=Network(db298d76-06d0-47c2-9b64-87949505d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1e4d26-0a')
Nov 15 23:44:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Deleting instance files /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354_del
Nov 15 23:44:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Deletion of /opt/stack/data/nova/instances/6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354_del complete
Nov 15 23:44:01 user nova-compute[76391]: INFO nova.compute.manager [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 23:44:01 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:44:01 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:44:02 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Took 0.71 seconds to deallocate network for instance.
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-495e84cf-f4c5-4164-902a-74b5c39f7860 req-7e8405f9-5a7a-45d6-aa5b-0d284ad17e7b service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-vif-deleted-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:44:02 user nova-compute[76391]: INFO nova.compute.manager [req-495e84cf-f4c5-4164-902a-74b5c39f7860 req-7e8405f9-5a7a-45d6-aa5b-0d284ad17e7b service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Neutron deleted interface cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1; detaching it from the instance and deleting it from the info cache
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.network.neutron [req-495e84cf-f4c5-4164-902a-74b5c39f7860 req-7e8405f9-5a7a-45d6-aa5b-0d284ad17e7b service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-495e84cf-f4c5-4164-902a-74b5c39f7860 req-7e8405f9-5a7a-45d6-aa5b-0d284ad17e7b service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Detach interface failed, port_id=cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1, reason: Instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:02 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Deleted allocations for instance 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354
Nov 15 23:44:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a7f67913-ddc6-4882-b3a9-38494ec7c6ff tempest-SnapshotDataIntegrityTests-1887883826 tempest-SnapshotDataIntegrityTests-1887883826-project-member] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.917s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-8dece281-b583-44db-a592-e02fb49af085 req-46164029-6031-4754-9ac3-54aec751a698 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received event network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8dece281-b583-44db-a592-e02fb49af085 req-46164029-6031-4754-9ac3-54aec751a698 service nova] Acquiring lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8dece281-b583-44db-a592-e02fb49af085 req-46164029-6031-4754-9ac3-54aec751a698 service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-8dece281-b583-44db-a592-e02fb49af085 req-46164029-6031-4754-9ac3-54aec751a698 service nova] Lock "6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-8dece281-b583-44db-a592-e02fb49af085 req-46164029-6031-4754-9ac3-54aec751a698 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] No waiting events found dispatching network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:44:02 user nova-compute[76391]: WARNING nova.compute.manager [req-8dece281-b583-44db-a592-e02fb49af085 req-46164029-6031-4754-9ac3-54aec751a698 service nova] [instance: 6ddfb09c-80bf-4f43-a8d8-6f8ad62e0354] Received unexpected event network-vif-plugged-cd1e4d26-0ae1-48ff-88e5-c8e9f09e24b1 for instance with vm_state deleted and task_state None.
Nov 15 23:44:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:44:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-changed-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG nova.compute.manager [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Refreshing instance network info cache due to event network-changed-08fa8f52-7192-4797-9cb2-b5df2499e983. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] Acquiring lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] Acquired lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Refreshing network info cache for port 08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Updated VIF entry in instance network info cache for port 08fa8f52-7192-4797-9cb2-b5df2499e983. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG nova.network.neutron [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Updating instance_info_cache with network_info: [{"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-920929ee-c29d-4ebb-98c6-189a74910723 req-6968e13d-3b05-4181-af2b-4e4959457a3f service nova] Releasing lock "refresh_cache-d89773a1-53cd-467f-a7cf-fdd51166bfce" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "d89773a1-53cd-467f-a7cf-fdd51166bfce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:30 user nova-compute[76391]: INFO nova.compute.manager [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Terminating instance
Nov 15 23:44:30 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-3fb05af0-6542-4ca3-8f26-cc7ba45e61d5 req-3a1109d4-f8e5-42ac-839f-4f646c755d6e service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-vif-unplugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3fb05af0-6542-4ca3-8f26-cc7ba45e61d5 req-3a1109d4-f8e5-42ac-839f-4f646c755d6e service nova] Acquiring lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3fb05af0-6542-4ca3-8f26-cc7ba45e61d5 req-3a1109d4-f8e5-42ac-839f-4f646c755d6e service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3fb05af0-6542-4ca3-8f26-cc7ba45e61d5 req-3a1109d4-f8e5-42ac-839f-4f646c755d6e service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-3fb05af0-6542-4ca3-8f26-cc7ba45e61d5 req-3a1109d4-f8e5-42ac-839f-4f646c755d6e service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] No waiting events found dispatching network-vif-unplugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-3fb05af0-6542-4ca3-8f26-cc7ba45e61d5 req-3a1109d4-f8e5-42ac-839f-4f646c755d6e service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-vif-unplugged-08fa8f52-7192-4797-9cb2-b5df2499e983 for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Instance destroyed successfully.
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.objects.instance [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'resources' on Instance uuid d89773a1-53cd-467f-a7cf-fdd51166bfce {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1680475757',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1680475757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1680475757',id=49,image_ref='913085ab-687b-4570-979d-8f0bd3c0ee4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL7UEo54Q9Z1prBPs4/SnsaGcg5Mh3SbuwyJxE64MKz/YtX83O/wqFPnuh3q0c+AhjUexg+03ZRRlCEJKqV4X/t7igZuXEpfWU6xECLkp2Lpy5oZFLZJnPlI/b02QMTpA==',key_name='tempest-keypair-1310557488',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:42:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-tvo7ny1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1132666866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:42:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8b2b277f69f480f8a2c102a46792247',uuid=d89773a1-53cd-467f-a7cf-fdd51166bfce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "08fa8f52-7192-4797-9cb2-b5df2499e983", "address": "fa:16:3e:ec:9c:2f", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fa8f52-71", "ovs_interfaceid": "08fa8f52-7192-4797-9cb2-b5df2499e983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=08fa8f52-7192-4797-9cb2-b5df2499e983,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fa8f52-71') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_vif [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=08fa8f52-7192-4797-9cb2-b5df2499e983,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fa8f52-71') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08fa8f52-71, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06e8976c-4e97-40f0-8527-8e98e0e283f4) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:44:31 user nova-compute[76391]: INFO os_vif [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=08fa8f52-7192-4797-9cb2-b5df2499e983,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fa8f52-71')
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmhIKpFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:44:31 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321eafe-72be-46cc-8374-969a08cba66d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:44:31 user nova-compute[76391]: No targets found.
Nov 15 23:44:31 user nova-compute[76391]: iSNS:
Nov 15 23:44:31 user nova-compute[76391]: No targets found.
Nov 15 23:44:31 user nova-compute[76391]: STATIC:
Nov 15 23:44:31 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:44:31 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:44:31 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:44:31 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca
Nov 15 23:44:31 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:44:31 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:44:31 user nova-compute[76391]: FIRMWARE:
Nov 15 23:44:31 user nova-compute[76391]: No targets found.
Nov 15 23:44:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:44:31 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:44:31 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4ad6ca-057f-4b51-a042-b7671272782f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[634ad373-a5d9-4fd6-90d9-4d0f1c6f1ad3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:44:31 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:44:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:44:31 user nova-compute[76391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca (non-flash)
Nov 15 23:44:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740350550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca'): ({'sde'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Removing single pathed devices sde {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2901a200-339f-4e6c-96fd-041850658caf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b87ee03-68d1-42ac-9968-096bbf9355c5]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flushing IO for device /dev/sde {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feba6c0-cabb-43ae-a91b-9cffa3d3e800]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4ddd7-e132-43e2-a05f-109ca8b0e4dc]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] SCSI volumes sde have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26530393834396262', '/dev/disk/by-id/scsi-1SCST_BIO4a704af-e09849bbdc22f641', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a704af') {{(pid=86206) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 23:44:31 user nova-compute[76391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26530393834396262
Nov 15 23:44:31 user nova-compute[76391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4a704af-e09849bbdc22f641
Nov 15 23:44:31 user nova-compute[76391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4a704af
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dcc579-d621-4f42-a703-8b814f934300]: (4, None) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46af877-bdee-4124-bec2-cc4effcc3a51]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[faedeaf3-f33e-45d1-83aa-33aefd527ef6]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260]
Nov 15 23:44:31 user nova-compute[76391]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca, portal: 172.16.0.220,3260] successful.
Nov 15 23:44:31 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22dfc9b7-99be-4156-afac-bac39f43f0ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[041bb553-7a2e-4496-8bae-cfe630ca5b42]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== disconnect_volume: return (300ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:44:31 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Deleting instance files /opt/stack/data/nova/instances/d89773a1-53cd-467f-a7cf-fdd51166bfce_del
Nov 15 23:44:31 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Deletion of /opt/stack/data/nova/instances/d89773a1-53cd-467f-a7cf-fdd51166bfce_del complete
Nov 15 23:44:31 user nova-compute[76391]: INFO nova.compute.manager [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 23:44:31 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:44:31 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:44:32 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:44:32 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Took 0.65 seconds to deallocate network for instance.
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-54e0f695-5c83-4d80-ba55-1801eb46ff18 req-023fd30f-532d-424d-802c-8636d8f13901 service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-54e0f695-5c83-4d80-ba55-1801eb46ff18 req-023fd30f-532d-424d-802c-8636d8f13901 service nova] Acquiring lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-54e0f695-5c83-4d80-ba55-1801eb46ff18 req-023fd30f-532d-424d-802c-8636d8f13901 service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-54e0f695-5c83-4d80-ba55-1801eb46ff18 req-023fd30f-532d-424d-802c-8636d8f13901 service nova] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-54e0f695-5c83-4d80-ba55-1801eb46ff18 req-023fd30f-532d-424d-802c-8636d8f13901 service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] No waiting events found dispatching network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:44:33 user nova-compute[76391]: WARNING nova.compute.manager [req-54e0f695-5c83-4d80-ba55-1801eb46ff18 req-023fd30f-532d-424d-802c-8636d8f13901 service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received unexpected event network-vif-plugged-08fa8f52-7192-4797-9cb2-b5df2499e983 for instance with vm_state active and task_state deleting.
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-54e0f695-5c83-4d80-ba55-1801eb46ff18 req-023fd30f-532d-424d-802c-8636d8f13901 service nova] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Received event network-vif-deleted-08fa8f52-7192-4797-9cb2-b5df2499e983 {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:44:33 user nova-compute[76391]: INFO nova.compute.manager [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: d89773a1-53cd-467f-a7cf-fdd51166bfce] Deleting volume: 22dfc9b7-99be-4156-afac-bac39f43f0ca {{(pid=76391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:33 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Deleted allocations for instance d89773a1-53cd-467f-a7cf-fdd51166bfce
Nov 15 23:44:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-e25a6b0a-6e58-49d1-8ac6-03dbdf97f329 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "d89773a1-53cd-467f-a7cf-fdd51166bfce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.042s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:34 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updating instance_info_cache with network_info: [{"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:44:34 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-19794d53-9572-436b-b2b5-cdd2c7d342bb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:44:34 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:44:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:44:37 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:44:37 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:44:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.070159912109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance 19794d53-9572-436b-b2b5-cdd2c7d342bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:44:37 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:44:38 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:44:38 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:44:38 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:44:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:44:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:44:42 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:44:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:44:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:45:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:45:23 user nova-compute[76391]: INFO nova.compute.manager [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Terminating instance
Nov 15 23:45:23 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-18b3d419-c23e-434a-9d2c-6f4127238aab req-909c21d2-d9dc-4bbb-8972-9a54f7958eb8 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-vif-unplugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-18b3d419-c23e-434a-9d2c-6f4127238aab req-909c21d2-d9dc-4bbb-8972-9a54f7958eb8 service nova] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-18b3d419-c23e-434a-9d2c-6f4127238aab req-909c21d2-d9dc-4bbb-8972-9a54f7958eb8 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-18b3d419-c23e-434a-9d2c-6f4127238aab req-909c21d2-d9dc-4bbb-8972-9a54f7958eb8 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-18b3d419-c23e-434a-9d2c-6f4127238aab req-909c21d2-d9dc-4bbb-8972-9a54f7958eb8 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] No waiting events found dispatching network-vif-unplugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:45:23 user nova-compute[76391]: DEBUG nova.compute.manager [req-18b3d419-c23e-434a-9d2c-6f4127238aab req-909c21d2-d9dc-4bbb-8972-9a54f7958eb8 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-vif-unplugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:45:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Instance destroyed successfully.
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.objects.instance [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'resources' on Instance uuid 19794d53-9572-436b-b2b5-cdd2c7d342bb {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-304361143',display_name='tempest-TestVolumeBootPattern-volume-backed-server-304361143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-304361143',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEA+9/98OjjrpIy5x6yCN6GqehH0ubuVdd96IXONjDVBnBAouPDM7WXFpWfw4hznpltxdLiRgAP5YD7Rqy9pBTKrbJNEsFK4VlEmEk3AejWczHrh/QamqCvdlBXUN5jhgQ==',key_name='tempest-keypair-1377286807',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-jyfr3m9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8b2b277f69f480f8a2c102a46792247',uuid=19794d53-9572-436b-b2b5-cdd2c7d342bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "address": "fa:16:3e:92:9c:da", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffe0d3c-a1", "ovs_interfaceid": "cffe0d3c-a19c-4bd3-a559-55a9a2cee6de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:9c:da,bridge_name='br-int',has_traffic_filtering=True,id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffe0d3c-a1') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_vif [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:9c:da,bridge_name='br-int',has_traffic_filtering=True,id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffe0d3c-a1') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcffe0d3c-a1, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffce88a1-2b79-4995-89c5-4eb31fdcaf38) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:45:24 user nova-compute[76391]: INFO os_vif [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:9c:da,bridge_name='br-int',has_traffic_filtering=True,id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffe0d3c-a1')
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspzrbLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:45:24 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f07accf-15c9-4ffb-b540-5dc181baf1b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:45:24 user nova-compute[76391]: No targets found.
Nov 15 23:45:24 user nova-compute[76391]: iSNS:
Nov 15 23:45:24 user nova-compute[76391]: No targets found.
Nov 15 23:45:24 user nova-compute[76391]: STATIC:
Nov 15 23:45:24 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb
Nov 15 23:45:24 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:45:24 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:45:24 user nova-compute[76391]: FIRMWARE:
Nov 15 23:45:24 user nova-compute[76391]: No targets found.
Nov 15 23:45:24 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:45:24 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:45:24 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[367c50d3-abc0-4c79-b22d-ace7006d89d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a8920a-1fb7-4e20-a6a6-969bf1770752]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:45:24 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb (non-flash)
Nov 15 23:45:24 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f976038a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c734cfb-cef4-4701-bc78-f23a45ec8acf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74340e6f-6e43-4ed0-8492-99ed07896723]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e9144-bf5b-4247-9956-779de6ccdad0]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9822f0-5556-4965-84c4-2d17414d17ba]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_832890f', '/dev/disk/by-id/scsi-1SCST_BIO832890f-9a5022dbc2542700', '/dev/disk/by-id/scsi-23961353032326462') {{(pid=86206) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb0956-fbaa-4c7b-8325-7314e3bb50cc]: (4, None) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc12608-4401-4cc7-81bc-6234be323d68]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46407f79-1605-4597-b758-4f0be0e266ee]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260]
Nov 15 23:45:24 user nova-compute[76391]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb, portal: 172.16.0.220,3260] successful.
Nov 15 23:45:24 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ecbbc4-0747-407e-ac4d-8422e3089efb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a1f863-6646-49b6-b638-b36d08167b55]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== disconnect_volume: return (318ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:45:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Deleting instance files /opt/stack/data/nova/instances/19794d53-9572-436b-b2b5-cdd2c7d342bb_del
Nov 15 23:45:24 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Deletion of /opt/stack/data/nova/instances/19794d53-9572-436b-b2b5-cdd2c7d342bb_del complete
Nov 15 23:45:24 user nova-compute[76391]: INFO nova.compute.manager [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 23:45:24 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:45:24 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:45:25 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:45:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a3c3cc5-93c5-4c83-be02-b14eb6d0711a req-73bbdf9a-7fd3-4ee9-b1c2-07d4d4e814b8 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-vif-deleted-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:45:25 user nova-compute[76391]: INFO nova.compute.manager [req-5a3c3cc5-93c5-4c83-be02-b14eb6d0711a req-73bbdf9a-7fd3-4ee9-b1c2-07d4d4e814b8 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Neutron deleted interface cffe0d3c-a19c-4bd3-a559-55a9a2cee6de; detaching it from the instance and deleting it from the info cache
Nov 15 23:45:25 user nova-compute[76391]: DEBUG nova.network.neutron [req-5a3c3cc5-93c5-4c83-be02-b14eb6d0711a req-73bbdf9a-7fd3-4ee9-b1c2-07d4d4e814b8 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:45:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a3c3cc5-93c5-4c83-be02-b14eb6d0711a req-73bbdf9a-7fd3-4ee9-b1c2-07d4d4e814b8 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Detach interface failed, port_id=cffe0d3c-a19c-4bd3-a559-55a9a2cee6de, reason: Instance 19794d53-9572-436b-b2b5-cdd2c7d342bb could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:45:25 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Took 0.74 seconds to deallocate network for instance.
Nov 15 23:45:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-cfaf177a-fbc0-4f77-a03c-b3a929888bbd req-696bb1b0-7c86-4d72-97cf-c643c17e7fb9 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received event network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:45:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cfaf177a-fbc0-4f77-a03c-b3a929888bbd req-696bb1b0-7c86-4d72-97cf-c643c17e7fb9 service nova] Acquiring lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:45:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cfaf177a-fbc0-4f77-a03c-b3a929888bbd req-696bb1b0-7c86-4d72-97cf-c643c17e7fb9 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:45:25 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-cfaf177a-fbc0-4f77-a03c-b3a929888bbd req-696bb1b0-7c86-4d72-97cf-c643c17e7fb9 service nova] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:45:25 user nova-compute[76391]: DEBUG nova.compute.manager [req-cfaf177a-fbc0-4f77-a03c-b3a929888bbd req-696bb1b0-7c86-4d72-97cf-c643c17e7fb9 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] No waiting events found dispatching network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:45:25 user nova-compute[76391]: WARNING nova.compute.manager [req-cfaf177a-fbc0-4f77-a03c-b3a929888bbd req-696bb1b0-7c86-4d72-97cf-c643c17e7fb9 service nova] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Received unexpected event network-vif-plugged-cffe0d3c-a19c-4bd3-a559-55a9a2cee6de for instance with vm_state active and task_state deleting.
Nov 15 23:45:26 user nova-compute[76391]: INFO nova.compute.manager [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Took 0.76 seconds to detach 1 volumes for instance.
Nov 15 23:45:26 user nova-compute[76391]: DEBUG nova.compute.manager [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: 19794d53-9572-436b-b2b5-cdd2c7d342bb] Deleting volume: 33ecbbc4-0747-407e-ac4d-8422e3089efb {{(pid=76391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 23:45:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:45:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:45:26 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:45:26 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:45:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:45:26 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Deleted allocations for instance 19794d53-9572-436b-b2b5-cdd2c7d342bb
Nov 15 23:45:26 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-a4c01f4b-669d-4b05-8c9d-f6aa37dda639 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "19794d53-9572-436b-b2b5-cdd2c7d342bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.013s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:45:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:45:35 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:45:35 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:45:38 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:45:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:45:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:45:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=9076MB free_disk=25.05657958984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:45:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:45:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:45:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:45:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:45:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:45:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:45:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:45:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:45:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:45:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:46:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:46:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "efae2b29-7a6f-4545-9171-61ff0e1270a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:46:22 user nova-compute[76391]: INFO nova.compute.claims [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Claim successful on node user
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.network.neutron [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:46:22 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:46:22 user nova-compute[76391]: INFO nova.virt.block_device [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Booting with volume 8dc9816e-05ce-43a9-984d-2453458c5c56 at /dev/vda
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.policy [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8b2b277f69f480f8a2c102a46792247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b3dc7e25d24f309b8c4bb7be5ad0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG os_brick.utils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7784f043-1926-4916-ac31-e58da7ecc117]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c5d3e-a8b2-486b-ab4b-48edc98d5da9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4e9ba-46d4-459e-aa0d-2d5f6f5d23e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa0b12-f704-49d0-a18a-758495e34c5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:46:22 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:46:22 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6248777-826f-48f9-8cb9-4392d34a40ab]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG os_brick.utils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:46:22 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating existing volume attachment record: 2f51c268-a2c8-4bb9-ad6d-caef0a46ea7a {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:46:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Successfully created port: 773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:46:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Successfully updated port: 773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:46:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:46:23 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquired lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:46:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:46:23 user nova-compute[76391]: DEBUG nova.network.neutron [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-changed-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG nova.compute.manager [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Refreshing instance network info cache due to event network-changed-773fdde6-3fa1-4dfa-8d75-04123f11a8ae. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] Acquiring lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG nova.network.neutron [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating instance_info_cache with network_info: [{"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Releasing lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Instance network_info: |[{"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] Acquired lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Refreshing network info cache for port 773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updated VIF entry in instance network info cache for port 773fdde6-3fa1-4dfa-8d75-04123f11a8ae. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG nova.network.neutron [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating instance_info_cache with network_info: [{"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:46:24 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-aec56502-55ee-47f4-9189-82431f680995 req-3fd24cb7-20b3-4970-bfc6-b73d6f570231 service nova] Releasing lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:46:27 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Creating image(s)
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Ensure instance console log exists: /opt/stack/data/nova/instances/efae2b29-7a6f-4545-9171-61ff0e1270a7/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Start _get_guest_xml network_info=[{"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'efae2b29-7a6f-4545-9171-61ff0e1270a7', 'attached_at': '', 'detached_at': '', 'volume_id': '8dc9816e-05ce-43a9-984d-2453458c5c56', 'serial': '8dc9816e-05ce-43a9-984d-2453458c5c56'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '2f51c268-a2c8-4bb9-ad6d-caef0a46ea7a', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:46:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:46:27 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:46:27 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:46:27 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:46:27 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f30f2a-042b-4922-8b39-efb60dd55208]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:46:27 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb3f72-e8ba-4846-89d3-8b341ff487f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56] added
Nov 15 23:46:27 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14df3e8-a523-42c0-96a7-9ee7f31bb9ee]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7fb62-8ee1-4b20-969a-bce19738786f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imwaJIPs {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imwaJIPs" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[375b550d-6783-445c-9219-ac87f51b251b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'imwaJIPs'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90579467-4f12-4c3e-9b00-fa82d5bdb1f1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b5b9c-5dc3-4a81-819f-4e9550a2a790]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:46:27 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:46:27 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:46:27 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:46:27 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:46:27 user nova-compute[76391]: 
Nov 15 23:46:27 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca6e32b-455c-446c-8774-74ae0a2e97bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]
Nov 15 23:46:28 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.
Nov 15 23:46:28 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa9081f-a717-4468-8416-56ab266c91a3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5177041-36ed-4a68-a58c-59e7009d8099]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:46:28 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:46:28 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b10ad-1a6b-47a4-a2a1-0013e3b0d10a]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:46:28 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23139336332313561', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139336332313561', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-272899368',display_name='tempest-TestVolumeBootPattern-server-272899368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-272899368',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-3sw4it19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:46:23Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=efae2b29-7a6f-4545-9171-61ff0e1270a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:b8,bridge_name='br-int',has_traffic_filtering=True,id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap773fdde6-3f') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.objects.instance [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'pci_devices' on Instance uuid efae2b29-7a6f-4545-9171-61ff0e1270a7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:46:29 user nova-compute[76391]:   <uuid>efae2b29-7a6f-4545-9171-61ff0e1270a7</uuid>
Nov 15 23:46:29 user nova-compute[76391]:   <name>instance-00000032</name>
Nov 15 23:46:29 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:46:29 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:46:29 user nova-compute[76391]:   <metadata>
Nov 15 23:46:29 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:46:29 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:46:29 user nova-compute[76391]:       <nova:name>tempest-TestVolumeBootPattern-server-272899368</nova:name>
Nov 15 23:46:29 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:46:27</nova:creationTime>
Nov 15 23:46:29 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:46:29 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:46:29 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:46:29 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:46:29 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:46:29 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:46:29 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:46:29 user nova-compute[76391]:       <nova:owner>
Nov 15 23:46:29 user nova-compute[76391]:         <nova:user uuid="b8b2b277f69f480f8a2c102a46792247">tempest-TestVolumeBootPattern-1132666866-project-member</nova:user>
Nov 15 23:46:29 user nova-compute[76391]:         <nova:project uuid="93b3dc7e25d24f309b8c4bb7be5ad0f2">tempest-TestVolumeBootPattern-1132666866</nova:project>
Nov 15 23:46:29 user nova-compute[76391]:       </nova:owner>
Nov 15 23:46:29 user nova-compute[76391]:       <nova:ports>
Nov 15 23:46:29 user nova-compute[76391]:         <nova:port uuid="773fdde6-3fa1-4dfa-8d75-04123f11a8ae">
Nov 15 23:46:29 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 23:46:29 user nova-compute[76391]:         </nova:port>
Nov 15 23:46:29 user nova-compute[76391]:       </nova:ports>
Nov 15 23:46:29 user nova-compute[76391]:     </nova:instance>
Nov 15 23:46:29 user nova-compute[76391]:   </metadata>
Nov 15 23:46:29 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:46:29 user nova-compute[76391]:     <system>
Nov 15 23:46:29 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:46:29 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:46:29 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:46:29 user nova-compute[76391]:       <entry name="serial">efae2b29-7a6f-4545-9171-61ff0e1270a7</entry>
Nov 15 23:46:29 user nova-compute[76391]:       <entry name="uuid">efae2b29-7a6f-4545-9171-61ff0e1270a7</entry>
Nov 15 23:46:29 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:46:29 user nova-compute[76391]:     </system>
Nov 15 23:46:29 user nova-compute[76391]:   </sysinfo>
Nov 15 23:46:29 user nova-compute[76391]:   <os>
Nov 15 23:46:29 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:46:29 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:46:29 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:46:29 user nova-compute[76391]:   </os>
Nov 15 23:46:29 user nova-compute[76391]:   <features>
Nov 15 23:46:29 user nova-compute[76391]:     <acpi/>
Nov 15 23:46:29 user nova-compute[76391]:     <apic/>
Nov 15 23:46:29 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:46:29 user nova-compute[76391]:   </features>
Nov 15 23:46:29 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:46:29 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:46:29 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:46:29 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:46:29 user nova-compute[76391]:   </clock>
Nov 15 23:46:29 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:46:29 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:46:29 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:46:29 user nova-compute[76391]:   </cpu>
Nov 15 23:46:29 user nova-compute[76391]:   <devices>
Nov 15 23:46:29 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:46:29 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:46:29 user nova-compute[76391]:       <source dev="/dev/sdb"/>
Nov 15 23:46:29 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:46:29 user nova-compute[76391]:       <serial>8dc9816e-05ce-43a9-984d-2453458c5c56</serial>
Nov 15 23:46:29 user nova-compute[76391]:     </disk>
Nov 15 23:46:29 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:46:29 user nova-compute[76391]:       <mac address="fa:16:3e:59:52:b8"/>
Nov 15 23:46:29 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:46:29 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:46:29 user nova-compute[76391]:       <target dev="tap773fdde6-3f"/>
Nov 15 23:46:29 user nova-compute[76391]:     </interface>
Nov 15 23:46:29 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:46:29 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/efae2b29-7a6f-4545-9171-61ff0e1270a7/console.log" append="off"/>
Nov 15 23:46:29 user nova-compute[76391]:     </serial>
Nov 15 23:46:29 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:46:29 user nova-compute[76391]:     <video>
Nov 15 23:46:29 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:46:29 user nova-compute[76391]:     </video>
Nov 15 23:46:29 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:46:29 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:46:29 user nova-compute[76391]:     </rng>
Nov 15 23:46:29 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:46:29 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:46:29 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:46:29 user nova-compute[76391]:     </memballoon>
Nov 15 23:46:29 user nova-compute[76391]:   </devices>
Nov 15 23:46:29 user nova-compute[76391]: </domain>
Nov 15 23:46:29 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-272899368',display_name='tempest-TestVolumeBootPattern-server-272899368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-272899368',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-3sw4it19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:46:23Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=efae2b29-7a6f-4545-9171-61ff0e1270a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:b8,bridge_name='br-int',has_traffic_filtering=True,id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap773fdde6-3f') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG os_vif [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:b8,bridge_name='br-int',has_traffic_filtering=True,id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap773fdde6-3f') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32330e68-e6d6-50c8-9d41-50fa98a34afe', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap773fdde6-3f, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap773fdde6-3f, col_values=(('qos', UUID('17377b9c-79bd-4349-808c-fcb734cad753')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap773fdde6-3f, col_values=(('external_ids', {'iface-id': '773fdde6-3fa1-4dfa-8d75-04123f11a8ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:52:b8', 'vm-uuid': 'efae2b29-7a6f-4545-9171-61ff0e1270a7'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:29 user nova-compute[76391]: INFO os_vif [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:52:b8,bridge_name='br-int',has_traffic_filtering=True,id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap773fdde6-3f')
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:46:29 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No VIF found with MAC fa:16:3e:59:52:b8, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:46:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-16403139-da75-4d44-b2b3-8fac698dae72 req-ff3c02ca-e751-4081-a0b0-ec355cc47bcc service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:46:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-16403139-da75-4d44-b2b3-8fac698dae72 req-ff3c02ca-e751-4081-a0b0-ec355cc47bcc service nova] Acquiring lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:46:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-16403139-da75-4d44-b2b3-8fac698dae72 req-ff3c02ca-e751-4081-a0b0-ec355cc47bcc service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:46:31 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-16403139-da75-4d44-b2b3-8fac698dae72 req-ff3c02ca-e751-4081-a0b0-ec355cc47bcc service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:46:31 user nova-compute[76391]: DEBUG nova.compute.manager [req-16403139-da75-4d44-b2b3-8fac698dae72 req-ff3c02ca-e751-4081-a0b0-ec355cc47bcc service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] No waiting events found dispatching network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:46:31 user nova-compute[76391]: WARNING nova.compute.manager [req-16403139-da75-4d44-b2b3-8fac698dae72 req-ff3c02ca-e751-4081-a0b0-ec355cc47bcc service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received unexpected event network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae for instance with vm_state building and task_state spawning.
Nov 15 23:46:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:46:32 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Instance spawned successfully.
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:46:32 user nova-compute[76391]: INFO nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 15 23:46:32 user nova-compute[76391]: DEBUG nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:46:33 user nova-compute[76391]: INFO nova.compute.manager [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Took 10.82 seconds to build instance.
Nov 15 23:46:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-30a89f1a-3184-4b4f-9c82-44ebc4489a2e tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.917s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:46:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-39c31830-5154-4ca9-97f0-449db01bcef2 req-0b86f62e-0b74-48c0-a3fc-6cf7f51cbf2b service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:46:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-39c31830-5154-4ca9-97f0-449db01bcef2 req-0b86f62e-0b74-48c0-a3fc-6cf7f51cbf2b service nova] Acquiring lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:46:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-39c31830-5154-4ca9-97f0-449db01bcef2 req-0b86f62e-0b74-48c0-a3fc-6cf7f51cbf2b service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:46:33 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-39c31830-5154-4ca9-97f0-449db01bcef2 req-0b86f62e-0b74-48c0-a3fc-6cf7f51cbf2b service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:46:33 user nova-compute[76391]: DEBUG nova.compute.manager [req-39c31830-5154-4ca9-97f0-449db01bcef2 req-0b86f62e-0b74-48c0-a3fc-6cf7f51cbf2b service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] No waiting events found dispatching network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:46:33 user nova-compute[76391]: WARNING nova.compute.manager [req-39c31830-5154-4ca9-97f0-449db01bcef2 req-0b86f62e-0b74-48c0-a3fc-6cf7f51cbf2b service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received unexpected event network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae for instance with vm_state active and task_state None.
Nov 15 23:46:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid efae2b29-7a6f-4545-9171-61ff0e1270a7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating instance_info_cache with network_info: [{"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:46:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:46:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:46:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:46:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.046241760253906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance efae2b29-7a6f-4545-9171-61ff0e1270a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:46:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:46:40 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:46:40 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:46:40 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:46:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:46:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:46:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:46:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:46:44 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:46:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:46:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:46:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:02 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:47:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:11 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:47:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:47:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:47:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:47:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:47:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid efae2b29-7a6f-4545-9171-61ff0e1270a7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating instance_info_cache with network_info: [{"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:47:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:47:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:47:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.045578002929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance efae2b29-7a6f-4545-9171-61ff0e1270a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:47:39 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:47:40 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:47:40 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:47:40 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:47:40 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:47:40 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:47:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:47:41 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:47:44 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:46 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:46 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:47:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:47:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:47:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-changed-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Refreshing instance network info cache due to event network-changed-773fdde6-3fa1-4dfa-8d75-04123f11a8ae. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] Acquiring lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] Acquired lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG nova.network.neutron [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Refreshing network info cache for port 773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG nova.network.neutron [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updated VIF entry in instance network info cache for port 773fdde6-3fa1-4dfa-8d75-04123f11a8ae. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG nova.network.neutron [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating instance_info_cache with network_info: [{"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c5d863a2-b18b-4125-9f7f-41df0fc0c3fb req-2bf6b728-ce47-4f64-8cbc-81c565a10b53 service nova] Releasing lock "refresh_cache-efae2b29-7a6f-4545-9171-61ff0e1270a7" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "efae2b29-7a6f-4545-9171-61ff0e1270a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:48:14 user nova-compute[76391]: INFO nova.compute.manager [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Terminating instance
Nov 15 23:48:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:48:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Instance destroyed successfully.
Nov 15 23:48:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'resources' on Instance uuid efae2b29-7a6f-4545-9171-61ff0e1270a7 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-272899368',display_name='tempest-TestVolumeBootPattern-server-272899368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-272899368',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-3sw4it19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:46:33Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=efae2b29-7a6f-4545-9171-61ff0e1270a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "address": "fa:16:3e:59:52:b8", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap773fdde6-3f", "ovs_interfaceid": "773fdde6-3fa1-4dfa-8d75-04123f11a8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:52:b8,bridge_name='br-int',has_traffic_filtering=True,id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap773fdde6-3f') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_vif [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:52:b8,bridge_name='br-int',has_traffic_filtering=True,id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap773fdde6-3f') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap773fdde6-3f, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17377b9c-79bd-4349-808c-fcb734cad753) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:48:15 user nova-compute[76391]: INFO os_vif [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:52:b8,bridge_name='br-int',has_traffic_filtering=True,id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap773fdde6-3f')
Nov 15 23:48:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:48:15 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a428767d-c9ef-4ee1-9ca7-e58e911715cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:48:15 user nova-compute[76391]: No targets found.
Nov 15 23:48:15 user nova-compute[76391]: iSNS:
Nov 15 23:48:15 user nova-compute[76391]: No targets found.
Nov 15 23:48:15 user nova-compute[76391]: STATIC:
Nov 15 23:48:15 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56
Nov 15 23:48:15 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:48:15 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:48:15 user nova-compute[76391]: FIRMWARE:
Nov 15 23:48:15 user nova-compute[76391]: No targets found.
Nov 15 23:48:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:48:15 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:48:15 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a6b86f-536e-4c6e-8e18-366a5db23be4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dddb149-0921-49a3-8bf4-20344ddef93a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:48:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:48:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405cb640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29452967-bd2b-4781-a79c-12fca0a712e4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccff409f-1c9a-438b-8c2b-1653d7d3a0c4]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f27ab4c-3044-4575-a8f2-3993aebbcfd3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9331d7-8923-4093-b3cb-134056d7982b]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fb02abad', '/dev/disk/by-id/scsi-1SCST_BIOfb02abad-193c215a88bc4dc4', '/dev/disk/by-id/scsi-23139336332313561') {{(pid=86206) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ea957-0a17-48b9-aa58-93b8798d6cfb]: (4, None) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a2bd0-6489-45e7-8c2f-ce2e31492a7b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b714bc-27d2-44f3-a979-582ef6e224c6]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]
Nov 15 23:48:15 user nova-compute[76391]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.
Nov 15 23:48:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d019501-cad4-4731-9fc3-3b52b2a97b98]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== disconnect_volume: return (280ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:48:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:48:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Deleting instance files /opt/stack/data/nova/instances/efae2b29-7a6f-4545-9171-61ff0e1270a7_del
Nov 15 23:48:15 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Deletion of /opt/stack/data/nova/instances/efae2b29-7a6f-4545-9171-61ff0e1270a7_del complete
Nov 15 23:48:16 user nova-compute[76391]: INFO nova.compute.manager [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 15 23:48:16 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-vif-unplugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] Acquiring lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] No waiting events found dispatching network-vif-unplugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-vif-unplugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] Acquiring lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] No waiting events found dispatching network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:48:16 user nova-compute[76391]: WARNING nova.compute.manager [req-e0b15786-f428-44cc-b483-ee96c7f6261a req-d4726d58-ed20-4d8d-af1d-325a307d9c06 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received unexpected event network-vif-plugged-773fdde6-3fa1-4dfa-8d75-04123f11a8ae for instance with vm_state active and task_state deleting.
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:48:16 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Took 0.66 seconds to deallocate network for instance.
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-0a5595c8-5623-4f1a-8e26-0520e97c65bc req-7c570202-6e0f-4b25-8eae-9905bde5f0d5 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Received event network-vif-deleted-773fdde6-3fa1-4dfa-8d75-04123f11a8ae {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:48:16 user nova-compute[76391]: INFO nova.compute.manager [req-0a5595c8-5623-4f1a-8e26-0520e97c65bc req-7c570202-6e0f-4b25-8eae-9905bde5f0d5 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Neutron deleted interface 773fdde6-3fa1-4dfa-8d75-04123f11a8ae; detaching it from the instance and deleting it from the info cache
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.network.neutron [req-0a5595c8-5623-4f1a-8e26-0520e97c65bc req-7c570202-6e0f-4b25-8eae-9905bde5f0d5 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:48:16 user nova-compute[76391]: DEBUG nova.compute.manager [req-0a5595c8-5623-4f1a-8e26-0520e97c65bc req-7c570202-6e0f-4b25-8eae-9905bde5f0d5 service nova] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Detach interface failed, port_id=773fdde6-3fa1-4dfa-8d75-04123f11a8ae, reason: Instance efae2b29-7a6f-4545-9171-61ff0e1270a7 could not be found. {{(pid=76391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 23:48:17 user nova-compute[76391]: INFO nova.compute.manager [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: efae2b29-7a6f-4545-9171-61ff0e1270a7] Took 0.70 seconds to detach 1 volumes for instance.
Nov 15 23:48:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:48:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:48:17 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:48:17 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:48:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:48:17 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Deleted allocations for instance efae2b29-7a6f-4545-9171-61ff0e1270a7
Nov 15 23:48:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-3b8e0189-0acc-4e19-b165-73855f2a7d96 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "efae2b29-7a6f-4545-9171-61ff0e1270a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:48:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:48:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:48:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:48:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:48:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:48:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:48:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:48:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:48:41 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:48:41 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:48:41 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=25.044761657714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:48:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:48:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:48:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:46 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:48 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:48:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:48:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:48:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:49:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:49:06 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:49:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:49:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:49:06 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:49:06 user nova-compute[76391]: INFO nova.compute.claims [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Claim successful on node user
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.network.neutron [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:49:07 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.policy [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8b2b277f69f480f8a2c102a46792247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b3dc7e25d24f309b8c4bb7be5ad0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:49:07 user nova-compute[76391]: INFO nova.virt.block_device [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Booting with volume 8dc9816e-05ce-43a9-984d-2453458c5c56 at /dev/vda
Nov 15 23:49:07 user nova-compute[76391]: DEBUG os_brick.utils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29626e9-d4e2-4e42-8c3f-c83edcc9fce8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad5d1f-e7f8-46cb-97d9-435bd70ffead]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91249b1a-82a9-4887-b3d8-82958a73b8a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4994c7e-f781-408c-a601-b70f710dff0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:49:07 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:49:07 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[858c54f7-7146-4496-b64a-91b256a9133c]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG os_brick.utils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating existing volume attachment record: 6ebecffe-ac3e-496b-9b7f-ca6d80ea2c93 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:49:07 user nova-compute[76391]: DEBUG nova.network.neutron [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Successfully created port: d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG nova.network.neutron [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Successfully updated port: d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG nova.network.neutron [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-changed-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG nova.compute.manager [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Refreshing instance network info cache due to event network-changed-d81cf087-99fd-4ff4-b7e3-a6f81754197b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:49:08 user nova-compute[76391]: DEBUG nova.network.neutron [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG nova.network.neutron [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Instance network_info: |[{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG nova.network.neutron [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Refreshing network info cache for port d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG nova.network.neutron [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updated VIF entry in instance network info cache for port d81cf087-99fd-4ff4-b7e3-a6f81754197b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG nova.network.neutron [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:49:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-57634a18-f8b1-42a9-957f-458599c5fa5b req-6c475716-f47d-4592-850d-7525cc39eb9a service nova] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:49:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:49:12 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Creating image(s)
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Ensure instance console log exists: /opt/stack/data/nova/instances/ccf727a5-3a09-4e30-95ce-7676ef55c34d/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Start _get_guest_xml network_info=[{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ccf727a5-3a09-4e30-95ce-7676ef55c34d', 'attached_at': '', 'detached_at': '', 'volume_id': '8dc9816e-05ce-43a9-984d-2453458c5c56', 'serial': '8dc9816e-05ce-43a9-984d-2453458c5c56'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '6ebecffe-ac3e-496b-9b7f-ca6d80ea2c93', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:49:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:49:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:49:12 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:49:12 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:49:12 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab931a3-436e-48ba-9da0-b77102020c1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:49:12 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc5faa4-df0c-4eab-9a7a-84c573ac692a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56] added
Nov 15 23:49:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64485882-bdcf-42cc-96a7-b44a439184bb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[768545bb-4273-437f-b7d8-2d42f01b289c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imwaJIPs {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imwaJIPs" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dd901a-6ca2-4bd4-a336-ed0d7b62af70]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'imwaJIPs'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67af5701-feac-4e8c-bf87-783017df9e91]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e37343-e255-49bf-a344-b464f1e03b4c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:49:12 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:49:12 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:49:12 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:49:12 user nova-compute[76391]: 
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26947391-940b-40c7-95cb-d07912068e0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]
Nov 15 23:49:12 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.
Nov 15 23:49:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3dce85-ad4a-46be-a80b-07e04740b5d5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8314c21-4ac2-489a-8135-3195d5d232c9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:49:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:49:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6e7ee6-d6be-496e-b440-14643792520c]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:49:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23139336332313561', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139336332313561', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-563954367',display_name='tempest-TestVolumeBootPattern-server-563954367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-563954367',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-xskarav0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:49:07Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=ccf727a5-3a09-4e30-95ce-7676ef55c34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:77:32,bridge_name='br-int',has_traffic_filtering=True,id=d81cf087-99fd-4ff4-b7e3-a6f81754197b,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81cf087-99') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'pci_devices' on Instance uuid ccf727a5-3a09-4e30-95ce-7676ef55c34d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:49:13 user nova-compute[76391]:   <uuid>ccf727a5-3a09-4e30-95ce-7676ef55c34d</uuid>
Nov 15 23:49:13 user nova-compute[76391]:   <name>instance-00000033</name>
Nov 15 23:49:13 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:49:13 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:49:13 user nova-compute[76391]:   <metadata>
Nov 15 23:49:13 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:49:13 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:49:13 user nova-compute[76391]:       <nova:name>tempest-TestVolumeBootPattern-server-563954367</nova:name>
Nov 15 23:49:13 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:49:12</nova:creationTime>
Nov 15 23:49:13 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:49:13 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:49:13 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:49:13 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:49:13 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:49:13 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:49:13 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:49:13 user nova-compute[76391]:       <nova:owner>
Nov 15 23:49:13 user nova-compute[76391]:         <nova:user uuid="b8b2b277f69f480f8a2c102a46792247">tempest-TestVolumeBootPattern-1132666866-project-member</nova:user>
Nov 15 23:49:13 user nova-compute[76391]:         <nova:project uuid="93b3dc7e25d24f309b8c4bb7be5ad0f2">tempest-TestVolumeBootPattern-1132666866</nova:project>
Nov 15 23:49:13 user nova-compute[76391]:       </nova:owner>
Nov 15 23:49:13 user nova-compute[76391]:       <nova:ports>
Nov 15 23:49:13 user nova-compute[76391]:         <nova:port uuid="d81cf087-99fd-4ff4-b7e3-a6f81754197b">
Nov 15 23:49:13 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 23:49:13 user nova-compute[76391]:         </nova:port>
Nov 15 23:49:13 user nova-compute[76391]:       </nova:ports>
Nov 15 23:49:13 user nova-compute[76391]:     </nova:instance>
Nov 15 23:49:13 user nova-compute[76391]:   </metadata>
Nov 15 23:49:13 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:49:13 user nova-compute[76391]:     <system>
Nov 15 23:49:13 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:49:13 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:49:13 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:49:13 user nova-compute[76391]:       <entry name="serial">ccf727a5-3a09-4e30-95ce-7676ef55c34d</entry>
Nov 15 23:49:13 user nova-compute[76391]:       <entry name="uuid">ccf727a5-3a09-4e30-95ce-7676ef55c34d</entry>
Nov 15 23:49:13 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:49:13 user nova-compute[76391]:     </system>
Nov 15 23:49:13 user nova-compute[76391]:   </sysinfo>
Nov 15 23:49:13 user nova-compute[76391]:   <os>
Nov 15 23:49:13 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:49:13 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:49:13 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:49:13 user nova-compute[76391]:   </os>
Nov 15 23:49:13 user nova-compute[76391]:   <features>
Nov 15 23:49:13 user nova-compute[76391]:     <acpi/>
Nov 15 23:49:13 user nova-compute[76391]:     <apic/>
Nov 15 23:49:13 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:49:13 user nova-compute[76391]:   </features>
Nov 15 23:49:13 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:49:13 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:49:13 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:49:13 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:49:13 user nova-compute[76391]:   </clock>
Nov 15 23:49:13 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:49:13 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:49:13 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:49:13 user nova-compute[76391]:   </cpu>
Nov 15 23:49:13 user nova-compute[76391]:   <devices>
Nov 15 23:49:13 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:49:13 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:49:13 user nova-compute[76391]:       <source dev="/dev/sdb"/>
Nov 15 23:49:13 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:49:13 user nova-compute[76391]:       <serial>8dc9816e-05ce-43a9-984d-2453458c5c56</serial>
Nov 15 23:49:13 user nova-compute[76391]:     </disk>
Nov 15 23:49:13 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:49:13 user nova-compute[76391]:       <mac address="fa:16:3e:0f:77:32"/>
Nov 15 23:49:13 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:49:13 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:49:13 user nova-compute[76391]:       <target dev="tapd81cf087-99"/>
Nov 15 23:49:13 user nova-compute[76391]:     </interface>
Nov 15 23:49:13 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:49:13 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/ccf727a5-3a09-4e30-95ce-7676ef55c34d/console.log" append="off"/>
Nov 15 23:49:13 user nova-compute[76391]:     </serial>
Nov 15 23:49:13 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:49:13 user nova-compute[76391]:     <video>
Nov 15 23:49:13 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:49:13 user nova-compute[76391]:     </video>
Nov 15 23:49:13 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:49:13 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:49:13 user nova-compute[76391]:     </rng>
Nov 15 23:49:13 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:49:13 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:49:13 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:49:13 user nova-compute[76391]:     </memballoon>
Nov 15 23:49:13 user nova-compute[76391]:   </devices>
Nov 15 23:49:13 user nova-compute[76391]: </domain>
Nov 15 23:49:13 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-563954367',display_name='tempest-TestVolumeBootPattern-server-563954367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-563954367',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-xskarav0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:49:07Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=ccf727a5-3a09-4e30-95ce-7676ef55c34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:77:32,bridge_name='br-int',has_traffic_filtering=True,id=d81cf087-99fd-4ff4-b7e3-a6f81754197b,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81cf087-99') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG os_vif [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:77:32,bridge_name='br-int',has_traffic_filtering=True,id=d81cf087-99fd-4ff4-b7e3-a6f81754197b,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81cf087-99') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d920d03-b171-5583-9078-ec20025a54e6', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd81cf087-99, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd81cf087-99, col_values=(('qos', UUID('a5984f81-c1eb-4baa-84c4-32c5ca3c2bb8')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd81cf087-99, col_values=(('external_ids', {'iface-id': 'd81cf087-99fd-4ff4-b7e3-a6f81754197b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:77:32', 'vm-uuid': 'ccf727a5-3a09-4e30-95ce-7676ef55c34d'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:13 user nova-compute[76391]: INFO os_vif [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:77:32,bridge_name='br-int',has_traffic_filtering=True,id=d81cf087-99fd-4ff4-b7e3-a6f81754197b,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81cf087-99')
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:49:13 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No VIF found with MAC fa:16:3e:0f:77:32, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-164e5a0b-ca6a-4a9a-9148-f6c51a5548b6 req-1c353dd8-ecb3-47ed-b7f2-e130816aba94 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-164e5a0b-ca6a-4a9a-9148-f6c51a5548b6 req-1c353dd8-ecb3-47ed-b7f2-e130816aba94 service nova] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-164e5a0b-ca6a-4a9a-9148-f6c51a5548b6 req-1c353dd8-ecb3-47ed-b7f2-e130816aba94 service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-164e5a0b-ca6a-4a9a-9148-f6c51a5548b6 req-1c353dd8-ecb3-47ed-b7f2-e130816aba94 service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG nova.compute.manager [req-164e5a0b-ca6a-4a9a-9148-f6c51a5548b6 req-1c353dd8-ecb3-47ed-b7f2-e130816aba94 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] No waiting events found dispatching network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:49:15 user nova-compute[76391]: WARNING nova.compute.manager [req-164e5a0b-ca6a-4a9a-9148-f6c51a5548b6 req-1c353dd8-ecb3-47ed-b7f2-e130816aba94 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received unexpected event network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b for instance with vm_state building and task_state spawning.
Nov 15 23:49:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:49:17 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Instance spawned successfully.
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:49:17 user nova-compute[76391]: INFO nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:49:17 user nova-compute[76391]: INFO nova.compute.manager [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Took 10.56 seconds to build instance.
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.compute.manager [req-d085c6df-1954-46cd-ab11-ec65ef3d4427 req-250b388d-2ebc-4591-ac04-b669db34ee49 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d085c6df-1954-46cd-ab11-ec65ef3d4427 req-250b388d-2ebc-4591-ac04-b669db34ee49 service nova] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d085c6df-1954-46cd-ab11-ec65ef3d4427 req-250b388d-2ebc-4591-ac04-b669db34ee49 service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-d085c6df-1954-46cd-ab11-ec65ef3d4427 req-250b388d-2ebc-4591-ac04-b669db34ee49 service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:49:17 user nova-compute[76391]: DEBUG nova.compute.manager [req-d085c6df-1954-46cd-ab11-ec65ef3d4427 req-250b388d-2ebc-4591-ac04-b669db34ee49 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] No waiting events found dispatching network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:49:17 user nova-compute[76391]: WARNING nova.compute.manager [req-d085c6df-1954-46cd-ab11-ec65ef3d4427 req-250b388d-2ebc-4591-ac04-b669db34ee49 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received unexpected event network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b for instance with vm_state active and task_state None.
Nov 15 23:49:17 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-aa800fa7-5d8c-411a-9a3c-03b99c565f02 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.658s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:49:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:49:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:49:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:49:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:49:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid ccf727a5-3a09-4e30-95ce-7676ef55c34d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:49:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:49:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:49:43 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:49:43 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:49:43 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=25.043094635009766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance ccf727a5-3a09-4e30-95ce-7676ef55c34d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:49:43 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:49:44 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:49:44 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:49:44 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:49:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:49:46 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:46 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:48 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:49:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:49:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:49:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:49:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:49:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:58 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:49:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:49:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:49:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:49:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:49:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:49:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid ccf727a5-3a09-4e30-95ce-7676ef55c34d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:50:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:50:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:44 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:50:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:50:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:50:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.042491912841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance ccf727a5-3a09-4e30-95ce-7676ef55c34d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:50:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:50:46 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:50:46 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:50:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:50:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:50:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4992-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:50:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:50:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:50:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:50:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:50:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-changed-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Refreshing instance network info cache due to event network-changed-d81cf087-99fd-4ff4-b7e3-a6f81754197b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Refreshing network info cache for port d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updated VIF entry in instance network info cache for port d81cf087-99fd-4ff4-b7e3-a6f81754197b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:50:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-c367b9f1-c000-4a48-8fc4-b58a94a98903 req-fe53b007-faa3-4687-8152-7e4a66fed7e6 service nova] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:51:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:51:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:03 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:51:03 user nova-compute[76391]: INFO nova.compute.claims [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Claim successful on node user
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.network.neutron [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:51:04 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.policy [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8b2b277f69f480f8a2c102a46792247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b3dc7e25d24f309b8c4bb7be5ad0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:51:04 user nova-compute[76391]: INFO nova.virt.block_device [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Booting with volume eb2b5083-eee6-4dc3-afc4-32d3a19d1603 at /dev/vda
Nov 15 23:51:04 user nova-compute[76391]: DEBUG os_brick.utils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[219980f9-7e15-4ce3-810f-3acac5e7295a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f897f5a-cd69-4d92-a7c8-96624321d5a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1163b-c884-476b-ba91-0b525facd3b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c76cdf-5fa0-4347-a7fd-0b2783e79d78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:51:04 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:51:04 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a4e898-e16b-430e-b767-e56c4c0c4cfc]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG os_brick.utils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updating existing volume attachment record: b5fa7f54-5ea3-4409-ada6-f6fd3b43e02c {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:51:04 user nova-compute[76391]: DEBUG nova.network.neutron [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Successfully created port: 8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.network.neutron [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Successfully updated port: 8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquired lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.network.neutron [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-changed-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.compute.manager [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Refreshing instance network info cache due to event network-changed-8ea3be42-742a-4da4-9d64-aae963c56afc. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] Acquiring lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.network.neutron [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.network.neutron [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updating instance_info_cache with network_info: [{"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Releasing lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Instance network_info: |[{"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] Acquired lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:51:05 user nova-compute[76391]: DEBUG nova.network.neutron [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Refreshing network info cache for port 8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:51:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:06 user nova-compute[76391]: DEBUG nova.network.neutron [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updated VIF entry in instance network info cache for port 8ea3be42-742a-4da4-9d64-aae963c56afc. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:51:06 user nova-compute[76391]: DEBUG nova.network.neutron [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updating instance_info_cache with network_info: [{"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:51:06 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-804e447f-4d9f-43f9-b62a-aae47ffbd981 req-bebc8052-de60-4946-9da7-c1bfbf4c21cb service nova] Releasing lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.004s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Verify base images {{(pid=76391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=76391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] ccf727a5-3a09-4e30-95ce-7676ef55c34d is a valid instance name {{(pid=76391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f
Nov 15 23:51:08 user nova-compute[76391]: WARNING nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Removable base files: /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6 /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5 /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441 /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845 /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d5ba90f870f67eed22c9b9506404612d13ce4a6
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/210e55bc4418b725c6311fbdd28c802038a209bd
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee5f2f7f6c136b876cee0b6bf4a6f88a912b30de
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/380f002a96ea598463a4feb2659133ba7effbda5
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/83748adf5c966f1a55be3b1ed688c7b9610cb441
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/963d402708381c2327a6c6e0ea4b4655dff5d845
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d1278e39a10fb0e3fd52a64791825bf6c61235b
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/49d8401046d2d46950ee40cb15ae6c3522f2196f
Nov 15 23:51:08 user nova-compute[76391]: INFO nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b580f13412035ffeb89ca5a285cca49dfe67924b
Nov 15 23:51:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Verification complete {{(pid=76391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Verify swap images {{(pid=76391) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.imagecache [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Verify ephemeral images {{(pid=76391) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 23:51:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:51:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Creating image(s)
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Did not create local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Ensure instance console log exists: /opt/stack/data/nova/instances/a8299cd0-d2c7-454c-b1ca-cef4d3b828fb/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Start _get_guest_xml network_info=[{"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJjuICYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8299cd0-d2c7-454c-b1ca-cef4d3b828fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb2b5083-eee6-4dc3-afc4-32d3a19d1603', 'serial': 'eb2b5083-eee6-4dc3-afc4-32d3a19d1603'}, 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'b5fa7f54-5ea3-4409-ada6-f6fd3b43e02c', 'guest_format': None, 'volume_type': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:51:09 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:51:09 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJjuICYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:51:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:51:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:51:09 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d33fa4-d829-4632-848d-80711db6b755]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:51:09 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52745465-9fec-4bd3-9135-12eb84ad16c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603] added
Nov 15 23:51:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee725b8-7492-439c-9161-30b9e2bb26b3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[961903a7-f4b6-44d5-8caa-2ec8514a03f1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJjuICYq {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJjuICYq" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b3086-1267-4c2c-a67f-106dc375e61c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJjuICYq'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78863373-0aea-4b7b-aecc-49398c981e38]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba648ffb-c92d-4587-a6a5-bb772739fb12]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:51:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:51:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc800cd-c57e-4c4c-8014-2e015e9ff331]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260]
Nov 15 23:51:09 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260] successful.
Nov 15 23:51:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[897f1776-3b52-48a5-b34a-45a95f2d3767]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7211e4-9aa2-4cb4-ab11-e88a293d5ff0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:51:09 user nova-compute[76391]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 (non-flash)
Nov 15 23:51:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:51:09 user nova-compute[76391]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 (non-flash)
Nov 15 23:51:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74e995-06a0-44c5-86f8-f38f33397d7c]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:51:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJjuICYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23933623934656435', 'path': '/dev/sdc'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933623934656435', 'path': '/dev/sdc'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1257075455',display_name='tempest-TestVolumeBootPattern-server-1257075455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1257075455',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-iw0qard7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:51:04Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=a8299cd0-d2c7-454c-b1ca-cef4d3b828fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:10:bd,bridge_name='br-int',has_traffic_filtering=True,id=8ea3be42-742a-4da4-9d64-aae963c56afc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3be42-74') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.objects.instance [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'pci_devices' on Instance uuid a8299cd0-d2c7-454c-b1ca-cef4d3b828fb {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:51:10 user nova-compute[76391]:   <uuid>a8299cd0-d2c7-454c-b1ca-cef4d3b828fb</uuid>
Nov 15 23:51:10 user nova-compute[76391]:   <name>instance-00000034</name>
Nov 15 23:51:10 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:51:10 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:51:10 user nova-compute[76391]:   <metadata>
Nov 15 23:51:10 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:51:10 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:51:10 user nova-compute[76391]:       <nova:name>tempest-TestVolumeBootPattern-server-1257075455</nova:name>
Nov 15 23:51:10 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:51:09</nova:creationTime>
Nov 15 23:51:10 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:51:10 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:51:10 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:51:10 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:51:10 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:51:10 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:51:10 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:51:10 user nova-compute[76391]:       <nova:owner>
Nov 15 23:51:10 user nova-compute[76391]:         <nova:user uuid="b8b2b277f69f480f8a2c102a46792247">tempest-TestVolumeBootPattern-1132666866-project-member</nova:user>
Nov 15 23:51:10 user nova-compute[76391]:         <nova:project uuid="93b3dc7e25d24f309b8c4bb7be5ad0f2">tempest-TestVolumeBootPattern-1132666866</nova:project>
Nov 15 23:51:10 user nova-compute[76391]:       </nova:owner>
Nov 15 23:51:10 user nova-compute[76391]:       <nova:ports>
Nov 15 23:51:10 user nova-compute[76391]:         <nova:port uuid="8ea3be42-742a-4da4-9d64-aae963c56afc">
Nov 15 23:51:10 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 23:51:10 user nova-compute[76391]:         </nova:port>
Nov 15 23:51:10 user nova-compute[76391]:       </nova:ports>
Nov 15 23:51:10 user nova-compute[76391]:     </nova:instance>
Nov 15 23:51:10 user nova-compute[76391]:   </metadata>
Nov 15 23:51:10 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:51:10 user nova-compute[76391]:     <system>
Nov 15 23:51:10 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:51:10 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:51:10 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:51:10 user nova-compute[76391]:       <entry name="serial">a8299cd0-d2c7-454c-b1ca-cef4d3b828fb</entry>
Nov 15 23:51:10 user nova-compute[76391]:       <entry name="uuid">a8299cd0-d2c7-454c-b1ca-cef4d3b828fb</entry>
Nov 15 23:51:10 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:51:10 user nova-compute[76391]:     </system>
Nov 15 23:51:10 user nova-compute[76391]:   </sysinfo>
Nov 15 23:51:10 user nova-compute[76391]:   <os>
Nov 15 23:51:10 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:51:10 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:51:10 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:51:10 user nova-compute[76391]:   </os>
Nov 15 23:51:10 user nova-compute[76391]:   <features>
Nov 15 23:51:10 user nova-compute[76391]:     <acpi/>
Nov 15 23:51:10 user nova-compute[76391]:     <apic/>
Nov 15 23:51:10 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:51:10 user nova-compute[76391]:   </features>
Nov 15 23:51:10 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:51:10 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:51:10 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:51:10 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:51:10 user nova-compute[76391]:   </clock>
Nov 15 23:51:10 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:51:10 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:51:10 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:51:10 user nova-compute[76391]:   </cpu>
Nov 15 23:51:10 user nova-compute[76391]:   <devices>
Nov 15 23:51:10 user nova-compute[76391]:     <disk type="block" device="disk">
Nov 15 23:51:10 user nova-compute[76391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:51:10 user nova-compute[76391]:       <source dev="/dev/sdc"/>
Nov 15 23:51:10 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:51:10 user nova-compute[76391]:       <serial>eb2b5083-eee6-4dc3-afc4-32d3a19d1603</serial>
Nov 15 23:51:10 user nova-compute[76391]:     </disk>
Nov 15 23:51:10 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:51:10 user nova-compute[76391]:       <mac address="fa:16:3e:f0:10:bd"/>
Nov 15 23:51:10 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:51:10 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:51:10 user nova-compute[76391]:       <target dev="tap8ea3be42-74"/>
Nov 15 23:51:10 user nova-compute[76391]:     </interface>
Nov 15 23:51:10 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:51:10 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/a8299cd0-d2c7-454c-b1ca-cef4d3b828fb/console.log" append="off"/>
Nov 15 23:51:10 user nova-compute[76391]:     </serial>
Nov 15 23:51:10 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:51:10 user nova-compute[76391]:     <video>
Nov 15 23:51:10 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:51:10 user nova-compute[76391]:     </video>
Nov 15 23:51:10 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:51:10 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:51:10 user nova-compute[76391]:     </rng>
Nov 15 23:51:10 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:51:10 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:51:10 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:51:10 user nova-compute[76391]:     </memballoon>
Nov 15 23:51:10 user nova-compute[76391]:   </devices>
Nov 15 23:51:10 user nova-compute[76391]: </domain>
Nov 15 23:51:10 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1257075455',display_name='tempest-TestVolumeBootPattern-server-1257075455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1257075455',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-iw0qard7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:51:04Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=a8299cd0-d2c7-454c-b1ca-cef4d3b828fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:10:bd,bridge_name='br-int',has_traffic_filtering=True,id=8ea3be42-742a-4da4-9d64-aae963c56afc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3be42-74') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG os_vif [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:10:bd,bridge_name='br-int',has_traffic_filtering=True,id=8ea3be42-742a-4da4-9d64-aae963c56afc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3be42-74') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4041ca9-662b-58dc-9c51-c474c5035207', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea3be42-74, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ea3be42-74, col_values=(('qos', UUID('5cca145e-41ff-4989-b26c-2f46c22fae28')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ea3be42-74, col_values=(('external_ids', {'iface-id': '8ea3be42-742a-4da4-9d64-aae963c56afc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:10:bd', 'vm-uuid': 'a8299cd0-d2c7-454c-b1ca-cef4d3b828fb'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:10 user nova-compute[76391]: INFO os_vif [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:10:bd,bridge_name='br-int',has_traffic_filtering=True,id=8ea3be42-742a-4da4-9d64-aae963c56afc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3be42-74')
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:51:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] No VIF found with MAC fa:16:3e:f0:10:bd, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:51:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-0fe6aea5-46a7-410d-93be-067fcaf37a29 req-ddf685ff-e1da-40e5-9538-03aa49c3e362 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:51:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0fe6aea5-46a7-410d-93be-067fcaf37a29 req-ddf685ff-e1da-40e5-9538-03aa49c3e362 service nova] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0fe6aea5-46a7-410d-93be-067fcaf37a29 req-ddf685ff-e1da-40e5-9538-03aa49c3e362 service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:12 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-0fe6aea5-46a7-410d-93be-067fcaf37a29 req-ddf685ff-e1da-40e5-9538-03aa49c3e362 service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:12 user nova-compute[76391]: DEBUG nova.compute.manager [req-0fe6aea5-46a7-410d-93be-067fcaf37a29 req-ddf685ff-e1da-40e5-9538-03aa49c3e362 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] No waiting events found dispatching network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:51:12 user nova-compute[76391]: WARNING nova.compute.manager [req-0fe6aea5-46a7-410d-93be-067fcaf37a29 req-ddf685ff-e1da-40e5-9538-03aa49c3e362 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received unexpected event network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc for instance with vm_state building and task_state spawning.
Nov 15 23:51:12 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:51:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Instance spawned successfully.
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:51:14 user nova-compute[76391]: INFO nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a0c1cdb-e87e-4e7e-8556-bde0689e7f61 req-73af88bc-f912-4e2c-8de2-69cfa8663cdf service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a0c1cdb-e87e-4e7e-8556-bde0689e7f61 req-73af88bc-f912-4e2c-8de2-69cfa8663cdf service nova] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a0c1cdb-e87e-4e7e-8556-bde0689e7f61 req-73af88bc-f912-4e2c-8de2-69cfa8663cdf service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5a0c1cdb-e87e-4e7e-8556-bde0689e7f61 req-73af88bc-f912-4e2c-8de2-69cfa8663cdf service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:14 user nova-compute[76391]: DEBUG nova.compute.manager [req-5a0c1cdb-e87e-4e7e-8556-bde0689e7f61 req-73af88bc-f912-4e2c-8de2-69cfa8663cdf service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] No waiting events found dispatching network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:51:14 user nova-compute[76391]: WARNING nova.compute.manager [req-5a0c1cdb-e87e-4e7e-8556-bde0689e7f61 req-73af88bc-f912-4e2c-8de2-69cfa8663cdf service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received unexpected event network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc for instance with vm_state active and task_state None.
Nov 15 23:51:14 user nova-compute[76391]: INFO nova.compute.manager [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Took 10.28 seconds to build instance.
Nov 15 23:51:14 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-97c205d8-25fe-4013-9e6f-ce4ccf4f8836 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.385s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:51:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:51:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:51:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:51:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:51:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:51:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:51:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:51:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:39 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:51:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:51:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:51:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:51:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:51:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid ccf727a5-3a09-4e30-95ce-7676ef55c34d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:51:40 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:51:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:51:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:51:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:51:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:51:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.04062271118164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:51:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance ccf727a5-3a09-4e30-95ce-7676ef55c34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a8299cd0-d2c7-454c-b1ca-cef4d3b828fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:51:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:51:48 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:48 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:49 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:51:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:51:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:51:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:51:59 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:52:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid ccf727a5-3a09-4e30-95ce-7676ef55c34d {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Triggering sync for uuid a8299cd0-d2c7-454c-b1ca-cef4d3b828fb {{(pid=76391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:52:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:52:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:52:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:05 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:10 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:12 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:12 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:52:15 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:18 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:52:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:20 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:25 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:52:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:52:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:35 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updating instance_info_cache with network_info: [{"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:52:40 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:52:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:52:45 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:52:45 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.040069580078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance ccf727a5-3a09-4e30-95ce-7676ef55c34d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a8299cd0-d2c7-454c-b1ca-cef4d3b828fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:52:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:52:48 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:52:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:52:50 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:52:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:52:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:55 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-changed-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:52:56 user nova-compute[76391]: DEBUG nova.compute.manager [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Refreshing instance network info cache due to event network-changed-8ea3be42-742a-4da4-9d64-aae963c56afc. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:52:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] Acquiring lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:52:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] Acquired lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:52:56 user nova-compute[76391]: DEBUG nova.network.neutron [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Refreshing network info cache for port 8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updated VIF entry in instance network info cache for port 8ea3be42-742a-4da4-9d64-aae963c56afc. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updating instance_info_cache with network_info: [{"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-3be5fd6b-c74f-4fca-8f4e-8f7acf09539d req-f8356c0b-f537-4502-b644-4b119e213f51 service nova] Releasing lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-changed-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG nova.compute.manager [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Refreshing instance network info cache due to event network-changed-8ea3be42-742a-4da4-9d64-aae963c56afc. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] Acquiring lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] Acquired lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG nova.network.neutron [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Refreshing network info cache for port 8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:52:57 user nova-compute[76391]: INFO nova.compute.manager [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Terminating instance
Nov 15 23:52:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updated VIF entry in instance network info cache for port 8ea3be42-742a-4da4-9d64-aae963c56afc. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.network.neutron [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updating instance_info_cache with network_info: [{"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-737551f3-25f1-4f81-99fe-50fe5bfc2e80 req-8cf56e92-17ad-48f7-aedc-546218c2bcfb service nova] Releasing lock "refresh_cache-a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-vif-unplugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] No waiting events found dispatching network-vif-unplugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-vif-unplugged-8ea3be42-742a-4da4-9d64-aae963c56afc for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] Acquiring lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.compute.manager [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] No waiting events found dispatching network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:52:58 user nova-compute[76391]: WARNING nova.compute.manager [req-5d025a7a-980e-4691-ac11-ca1fc4af048d req-9bda4ac3-ec6c-4255-96da-a83e627881da service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received unexpected event network-vif-plugged-8ea3be42-742a-4da4-9d64-aae963c56afc for instance with vm_state active and task_state deleting.
Nov 15 23:52:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Instance destroyed successfully.
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.objects.instance [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'resources' on Instance uuid a8299cd0-d2c7-454c-b1ca-cef4d3b828fb {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1257075455',display_name='tempest-TestVolumeBootPattern-server-1257075455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1257075455',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-iw0qard7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:51:14Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=a8299cd0-d2c7-454c-b1ca-cef4d3b828fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "8ea3be42-742a-4da4-9d64-aae963c56afc", "address": "fa:16:3e:f0:10:bd", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3be42-74", "ovs_interfaceid": "8ea3be42-742a-4da4-9d64-aae963c56afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:10:bd,bridge_name='br-int',has_traffic_filtering=True,id=8ea3be42-742a-4da4-9d64-aae963c56afc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3be42-74') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_vif [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:10:bd,bridge_name='br-int',has_traffic_filtering=True,id=8ea3be42-742a-4da4-9d64-aae963c56afc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3be42-74') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea3be42-74, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cca145e-41ff-4989-b26c-2f46c22fae28) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:52:58 user nova-compute[76391]: INFO os_vif [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:10:bd,bridge_name='br-int',has_traffic_filtering=True,id=8ea3be42-742a-4da4-9d64-aae963c56afc,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3be42-74')
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJjuICYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:52:58 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f69d58-b2fb-42c4-bfdf-a7b4eb65fe3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:52:58 user nova-compute[76391]: No targets found.
Nov 15 23:52:58 user nova-compute[76391]: iSNS:
Nov 15 23:52:58 user nova-compute[76391]: No targets found.
Nov 15 23:52:58 user nova-compute[76391]: STATIC:
Nov 15 23:52:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603
Nov 15 23:52:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:52:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:52:58 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56
Nov 15 23:52:58 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:52:58 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:52:58 user nova-compute[76391]: FIRMWARE:
Nov 15 23:52:58 user nova-compute[76391]: No targets found.
Nov 15 23:52:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:52:58 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:52:58 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9619243e-d0af-49b5-9be0-ef7ea2e707f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[375b0e3d-98de-4f51-9fad-f06e533344c2]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:52:58 user nova-compute[76391]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 (non-flash)
Nov 15 23:52:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:52:58 user nova-compute[76391]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 (non-flash)
Nov 15 23:52:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740369d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603'): ({'sdc'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Removing single pathed devices sdc {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41e7e41-cace-4431-885b-174ea4355c81]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8354574b-ffb2-40c7-a2fa-803303cb1c15]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flushing IO for device /dev/sdc {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1efbaed-4083-4bb9-9671-04dc3a7b46b7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[730cabae-1b4a-45a9-91c8-c0a06a36b210]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] SCSI volumes sdc have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO42729ce-93b94ed5b6ce7185', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_42729ce', '/dev/disk/by-id/scsi-23933623934656435') {{(pid=86206) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a8dbfb-e36c-4ee1-9bdf-643ec686e94f]: (4, None) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25616e-9a82-453c-81b7-477d7dd781b7]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6df3e-b14d-4544-a3b7-56717c4ebdc0]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260]
Nov 15 23:52:58 user nova-compute[76391]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603, portal: 172.16.0.220,3260] successful.
Nov 15 23:52:58 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2b5083-eee6-4dc3-afc4-32d3a19d1603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cedf34-7cec-4f26-ad62-856515565cfb]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== disconnect_volume: return (336ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:52:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Deleting instance files /opt/stack/data/nova/instances/a8299cd0-d2c7-454c-b1ca-cef4d3b828fb_del
Nov 15 23:52:58 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Deletion of /opt/stack/data/nova/instances/a8299cd0-d2c7-454c-b1ca-cef4d3b828fb_del complete
Nov 15 23:52:58 user nova-compute[76391]: INFO nova.compute.manager [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 15 23:52:58 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:52:58 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:52:59 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:52:59 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Took 0.46 seconds to deallocate network for instance.
Nov 15 23:52:59 user nova-compute[76391]: DEBUG nova.compute.manager [req-570cefa9-3f6e-40bc-a032-a5508cf11615 req-8820b35a-1eb9-4e32-a4af-1cf15dc56172 service nova] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Received event network-vif-deleted-8ea3be42-742a-4da4-9d64-aae963c56afc {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:53:00 user nova-compute[76391]: INFO nova.compute.manager [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: a8299cd0-d2c7-454c-b1ca-cef4d3b828fb] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 23:53:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:00 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:53:00 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:53:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:00 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Deleted allocations for instance a8299cd0-d2c7-454c-b1ca-cef4d3b828fb
Nov 15 23:53:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-724ff8cb-6d3e-48c2-a907-02f8a8048708 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "a8299cd0-d2c7-454c-b1ca-cef4d3b828fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:03 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:08 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:13 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:18 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:33 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:38 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid ccf727a5-3a09-4e30-95ce-7676ef55c34d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:53:41 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:53:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:53:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:53:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:53:43 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:53:46 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:53:46 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:53:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.039180755615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance ccf727a5-3a09-4e30-95ce-7676ef55c34d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:53:46 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:53:47 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:53:47 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:53:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:48 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:51 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-changed-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Refreshing instance network info cache due to event network-changed-d81cf087-99fd-4ff4-b7e3-a6f81754197b. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] Acquiring lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] Acquired lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Refreshing network info cache for port d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:53 user nova-compute[76391]: INFO nova.compute.manager [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Terminating instance
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updated VIF entry in instance network info cache for port d81cf087-99fd-4ff4-b7e3-a6f81754197b. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.network.neutron [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [{"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-e936e48c-d618-40d0-b16b-57fde13361a5 req-d39ddd89-5510-45f9-bacb-c76d5d4e61e7 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-vif-unplugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e936e48c-d618-40d0-b16b-57fde13361a5 req-d39ddd89-5510-45f9-bacb-c76d5d4e61e7 service nova] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e936e48c-d618-40d0-b16b-57fde13361a5 req-d39ddd89-5510-45f9-bacb-c76d5d4e61e7 service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-e936e48c-d618-40d0-b16b-57fde13361a5 req-d39ddd89-5510-45f9-bacb-c76d5d4e61e7 service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-e936e48c-d618-40d0-b16b-57fde13361a5 req-d39ddd89-5510-45f9-bacb-c76d5d4e61e7 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] No waiting events found dispatching network-vif-unplugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG nova.compute.manager [req-e936e48c-d618-40d0-b16b-57fde13361a5 req-d39ddd89-5510-45f9-bacb-c76d5d4e61e7 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-vif-unplugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 23:53:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f6069fca-dc21-4deb-b5c6-4d28305d0bd5 req-4f8b6b28-2b21-4173-85c8-886a6af82343 service nova] Releasing lock "refresh_cache-ccf727a5-3a09-4e30-95ce-7676ef55c34d" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:53:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Instance destroyed successfully.
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.objects.instance [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lazy-loading 'resources' on Instance uuid ccf727a5-3a09-4e30-95ce-7676ef55c34d {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-563954367',display_name='tempest-TestVolumeBootPattern-server-563954367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-563954367',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvODchrb4ddX9tQtKeOdr4kZejQKzo81U568RD9bM0JwtPxSwJwqFR6XEpCTTxIBd5stfEY71zpOsZxpSAzFG60FykaOI77fZzvOpQtkltACbu79syjLT8+3bJFhQSDDQ==',key_name='tempest-TestVolumeBootPattern-807682445',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93b3dc7e25d24f309b8c4bb7be5ad0f2',ramdisk_id='',reservation_id='r-xskarav0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1132666866',owner_user_name='tempest-TestVolumeBootPattern-1132666866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:49:17Z,user_data=None,user_id='b8b2b277f69f480f8a2c102a46792247',uuid=ccf727a5-3a09-4e30-95ce-7676ef55c34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converting VIF {"id": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "address": "fa:16:3e:0f:77:32", "network": {"id": "1acd84a1-0f1f-441b-9181-63d123901966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-189220487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b3dc7e25d24f309b8c4bb7be5ad0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81cf087-99", "ovs_interfaceid": "d81cf087-99fd-4ff4-b7e3-a6f81754197b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:77:32,bridge_name='br-int',has_traffic_filtering=True,id=d81cf087-99fd-4ff4-b7e3-a6f81754197b,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81cf087-99') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_vif [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:77:32,bridge_name='br-int',has_traffic_filtering=True,id=d81cf087-99fd-4ff4-b7e3-a6f81754197b,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81cf087-99') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd81cf087-99, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5984f81-c1eb-4baa-84c4-32c5ca3c2bb8) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:53:54 user nova-compute[76391]: INFO os_vif [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:77:32,bridge_name='br-int',has_traffic_filtering=True,id=d81cf087-99fd-4ff4-b7e3-a6f81754197b,network=Network(1acd84a1-0f1f-441b-9181-63d123901966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81cf087-99')
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imwaJIPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:53:54 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b236e1da-46bf-4e4e-a0f8-247245b8779b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:53:54 user nova-compute[76391]: No targets found.
Nov 15 23:53:54 user nova-compute[76391]: iSNS:
Nov 15 23:53:54 user nova-compute[76391]: No targets found.
Nov 15 23:53:54 user nova-compute[76391]: STATIC:
Nov 15 23:53:54 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56
Nov 15 23:53:54 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:53:54 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:53:54 user nova-compute[76391]: FIRMWARE:
Nov 15 23:53:54 user nova-compute[76391]: No targets found.
Nov 15 23:53:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:53:54 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:53:54 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbd5f8-f962-4e22-86d2-b2e1a1905ba7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c0e3b-7aa6-4747-ad18-94215e999186]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:53:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 (non-flash)
Nov 15 23:53:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9740586440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f7fb39-9633-4efb-bf8b-eee179bf12fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e33fe-c72e-49ea-b49e-08f82f4a8d04]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb07758-6bcf-4a99-89a8-455e61a3e17f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80a76e-351a-44bd-81e0-f6efd77a0b7e]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fb02abad', '/dev/disk/by-id/scsi-1SCST_BIOfb02abad-193c215a88bc4dc4', '/dev/disk/by-id/scsi-23139336332313561') {{(pid=86206) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d32a6-6fa8-4dd4-86ac-c2960171abe7]: (4, None) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6b339e-fb59-4099-a8ec-9d7c8138f992]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9593e343-106f-4cb7-bbfe-7349a8ba2f92]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260]
Nov 15 23:53:54 user nova-compute[76391]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56, portal: 172.16.0.220,3260] successful.
Nov 15 23:53:54 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9816e-05ce-43a9-984d-2453458c5c56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec19b11-e658-45eb-bda4-83ebb1e0dfef]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] <== disconnect_volume: return (288ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:53:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Deleting instance files /opt/stack/data/nova/instances/ccf727a5-3a09-4e30-95ce-7676ef55c34d_del
Nov 15 23:53:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Deletion of /opt/stack/data/nova/instances/ccf727a5-3a09-4e30-95ce-7676ef55c34d_del complete
Nov 15 23:53:54 user nova-compute[76391]: INFO nova.compute.manager [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 15 23:53:54 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 23:53:54 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:53:55 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Took 0.50 seconds to deallocate network for instance.
Nov 15 23:53:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-48b6e697-4a28-4795-b512-a37b0931abc0 req-5737d40f-9b8a-4a35-96ba-7fe1c143e264 service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-vif-deleted-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:53:55 user nova-compute[76391]: INFO nova.compute.manager [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 23:53:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-72def714-f3c6-4f94-b667-09fd706c9432 req-879eb3df-7e02-42ca-86dc-f9721ee6abce service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received event network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-72def714-f3c6-4f94-b667-09fd706c9432 req-879eb3df-7e02-42ca-86dc-f9721ee6abce service nova] Acquiring lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-72def714-f3c6-4f94-b667-09fd706c9432 req-879eb3df-7e02-42ca-86dc-f9721ee6abce service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-72def714-f3c6-4f94-b667-09fd706c9432 req-879eb3df-7e02-42ca-86dc-f9721ee6abce service nova] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG nova.compute.manager [req-72def714-f3c6-4f94-b667-09fd706c9432 req-879eb3df-7e02-42ca-86dc-f9721ee6abce service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] No waiting events found dispatching network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:53:55 user nova-compute[76391]: WARNING nova.compute.manager [req-72def714-f3c6-4f94-b667-09fd706c9432 req-879eb3df-7e02-42ca-86dc-f9721ee6abce service nova] [instance: ccf727a5-3a09-4e30-95ce-7676ef55c34d] Received unexpected event network-vif-plugged-d81cf087-99fd-4ff4-b7e3-a6f81754197b for instance with vm_state active and task_state deleting.
Nov 15 23:53:55 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:53:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:56 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Deleted allocations for instance ccf727a5-3a09-4e30-95ce-7676ef55c34d
Nov 15 23:53:56 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-c0fd3859-2b81-4cf4-8434-c33d9d82d052 tempest-TestVolumeBootPattern-1132666866 tempest-TestVolumeBootPattern-1132666866-project-member] Lock "ccf727a5-3a09-4e30-95ce-7676ef55c34d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.695s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:53:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:01 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:54:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:54:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:54:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:54:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:54:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:54:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:54:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:54:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:54:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:54:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:54:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:54:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:54:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:54:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:54:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:54:47 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:54:47 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:54:47 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=9148MB free_disk=25.038063049316406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:54:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:54:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:52 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:52 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:54:53 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:54:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:54:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:55:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:55:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:55:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:23 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:28 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:30 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Starting instance... {{(pid=76391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 23:55:36 user nova-compute[76391]: INFO nova.compute.claims [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Claim successful on node user
Nov 15 23:55:36 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:36 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Start building networks asynchronously for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Allocating IP information in the background. {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] allocate_for_instance() {{(pid=76391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 23:55:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 23:55:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Start building block device mappings for instance. {{(pid=76391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG nova.policy [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '154e047f797643c08e29ff8532b1ec23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1470804f7034c829b0ed7891f4c08ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Start spawning the instance on the hypervisor. {{(pid=76391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Creating instance directory {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 23:55:37 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Creating image(s)
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "/opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "/opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "6174d29f088c54e07781c0d2fe291d7c7371035c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.189s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk 1073741824 {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c,backing_fmt=raw /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk 1073741824" returned: 0 in 0.119s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "6174d29f088c54e07781c0d2fe291d7c7371035c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6174d29f088c54e07781c0d2fe291d7c7371035c --force-share --output=json" returned: 0 in 0.180s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk. size=1073741824 {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 23:55:37 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG nova.virt.disk.api [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Cannot resize image /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk to a smaller size. {{(pid=76391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Created local disks {{(pid=76391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Ensure instance console log exists: /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/console.log {{(pid=76391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:38 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Successfully created port: 5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Successfully updated port: 5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Building network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-changed-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.compute.manager [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Refreshing instance network info cache due to event network-changed-5ff54394-3a9d-49fb-9950-fb26648194eb. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Instance cache missing network info. {{(pid=76391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.neutron [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Instance network_info: |[{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.neutron [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Refreshing network info cache for port 5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Start _get_guest_xml network_info=[{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'image_id': '9fefdfab-50b0-4bb0-961e-aba7120d0851'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 23:55:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:55:39 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CPU controller missing on host. {{(pid=76391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.host [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CPU controller found on host. {{(pid=76391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T23:11:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T23:11:37Z,direct_url=<?>,disk_format='qcow2',id=9fefdfab-50b0-4bb0-961e-aba7120d0851,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51db500a5b640a2a364411daa46bdb3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T23:11:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Flavor limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Image limits 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Flavor pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Image pref 0:0:0 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Got 1 possible topologies {{(pid=76391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.hardware [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-641440636',display_name='tempest-SnapshotDataIntegrityTests-server-641440636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-641440636',id=53,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtmw8mdDizvfn83KH43o+Wm1/DpV9bcbeSwTPq3Ye5Dmq6PMy7cA6i18nuwWglQPZLw4/H81PZLCHW+YKFAfm/yBbjycnHzIhRoJE+yLzJmJCJnvboyKm3Bmw0NvMiuIw==',key_name='tempest-keypair-1791845361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1470804f7034c829b0ed7891f4c08ae',ramdisk_id='',reservation_id='r-6gmgd0uw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-49990460',owner_user_name='tempest-SnapshotDataIntegrityTests-49990460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154e047f797643c08e29ff8532b1ec23',uuid=a4c84cfd-3fcd-432b-be46-7a17c7467095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Converting VIF {"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:aa:7e,bridge_name='br-int',has_traffic_filtering=True,id=5ff54394-3a9d-49fb-9950-fb26648194eb,network=Network(863d351d-3fb5-48d6-80f1-12d06853e299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff54394-3a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'pci_devices' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] End _get_guest_xml xml=<domain type="kvm">
Nov 15 23:55:39 user nova-compute[76391]:   <uuid>a4c84cfd-3fcd-432b-be46-7a17c7467095</uuid>
Nov 15 23:55:39 user nova-compute[76391]:   <name>instance-00000035</name>
Nov 15 23:55:39 user nova-compute[76391]:   <memory>524288</memory>
Nov 15 23:55:39 user nova-compute[76391]:   <vcpu>1</vcpu>
Nov 15 23:55:39 user nova-compute[76391]:   <metadata>
Nov 15 23:55:39 user nova-compute[76391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 23:55:39 user nova-compute[76391]:       <nova:package version="0.0.0"/>
Nov 15 23:55:39 user nova-compute[76391]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-641440636</nova:name>
Nov 15 23:55:39 user nova-compute[76391]:       <nova:creationTime>2023-11-15 23:55:39</nova:creationTime>
Nov 15 23:55:39 user nova-compute[76391]:       <nova:flavor name="m1.tiny">
Nov 15 23:55:39 user nova-compute[76391]:         <nova:memory>512</nova:memory>
Nov 15 23:55:39 user nova-compute[76391]:         <nova:disk>1</nova:disk>
Nov 15 23:55:39 user nova-compute[76391]:         <nova:swap>0</nova:swap>
Nov 15 23:55:39 user nova-compute[76391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 23:55:39 user nova-compute[76391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 23:55:39 user nova-compute[76391]:       </nova:flavor>
Nov 15 23:55:39 user nova-compute[76391]:       <nova:owner>
Nov 15 23:55:39 user nova-compute[76391]:         <nova:user uuid="154e047f797643c08e29ff8532b1ec23">tempest-SnapshotDataIntegrityTests-49990460-project-member</nova:user>
Nov 15 23:55:39 user nova-compute[76391]:         <nova:project uuid="f1470804f7034c829b0ed7891f4c08ae">tempest-SnapshotDataIntegrityTests-49990460</nova:project>
Nov 15 23:55:39 user nova-compute[76391]:       </nova:owner>
Nov 15 23:55:39 user nova-compute[76391]:       <nova:root type="image" uuid="9fefdfab-50b0-4bb0-961e-aba7120d0851"/>
Nov 15 23:55:39 user nova-compute[76391]:       <nova:ports>
Nov 15 23:55:39 user nova-compute[76391]:         <nova:port uuid="5ff54394-3a9d-49fb-9950-fb26648194eb">
Nov 15 23:55:39 user nova-compute[76391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 23:55:39 user nova-compute[76391]:         </nova:port>
Nov 15 23:55:39 user nova-compute[76391]:       </nova:ports>
Nov 15 23:55:39 user nova-compute[76391]:     </nova:instance>
Nov 15 23:55:39 user nova-compute[76391]:   </metadata>
Nov 15 23:55:39 user nova-compute[76391]:   <sysinfo type="smbios">
Nov 15 23:55:39 user nova-compute[76391]:     <system>
Nov 15 23:55:39 user nova-compute[76391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 23:55:39 user nova-compute[76391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 23:55:39 user nova-compute[76391]:       <entry name="version">0.0.0</entry>
Nov 15 23:55:39 user nova-compute[76391]:       <entry name="serial">a4c84cfd-3fcd-432b-be46-7a17c7467095</entry>
Nov 15 23:55:39 user nova-compute[76391]:       <entry name="uuid">a4c84cfd-3fcd-432b-be46-7a17c7467095</entry>
Nov 15 23:55:39 user nova-compute[76391]:       <entry name="family">Virtual Machine</entry>
Nov 15 23:55:39 user nova-compute[76391]:     </system>
Nov 15 23:55:39 user nova-compute[76391]:   </sysinfo>
Nov 15 23:55:39 user nova-compute[76391]:   <os>
Nov 15 23:55:39 user nova-compute[76391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 23:55:39 user nova-compute[76391]:     <boot dev="hd"/>
Nov 15 23:55:39 user nova-compute[76391]:     <smbios mode="sysinfo"/>
Nov 15 23:55:39 user nova-compute[76391]:   </os>
Nov 15 23:55:39 user nova-compute[76391]:   <features>
Nov 15 23:55:39 user nova-compute[76391]:     <acpi/>
Nov 15 23:55:39 user nova-compute[76391]:     <apic/>
Nov 15 23:55:39 user nova-compute[76391]:     <vmcoreinfo/>
Nov 15 23:55:39 user nova-compute[76391]:   </features>
Nov 15 23:55:39 user nova-compute[76391]:   <clock offset="utc">
Nov 15 23:55:39 user nova-compute[76391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 23:55:39 user nova-compute[76391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 23:55:39 user nova-compute[76391]:     <timer name="hpet" present="no"/>
Nov 15 23:55:39 user nova-compute[76391]:   </clock>
Nov 15 23:55:39 user nova-compute[76391]:   <cpu mode="custom" match="exact">
Nov 15 23:55:39 user nova-compute[76391]:     <model>Nehalem</model>
Nov 15 23:55:39 user nova-compute[76391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 23:55:39 user nova-compute[76391]:   </cpu>
Nov 15 23:55:39 user nova-compute[76391]:   <devices>
Nov 15 23:55:39 user nova-compute[76391]:     <disk type="file" device="disk">
Nov 15 23:55:39 user nova-compute[76391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 23:55:39 user nova-compute[76391]:       <source file="/opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk"/>
Nov 15 23:55:39 user nova-compute[76391]:       <target dev="vda" bus="virtio"/>
Nov 15 23:55:39 user nova-compute[76391]:     </disk>
Nov 15 23:55:39 user nova-compute[76391]:     <interface type="ethernet">
Nov 15 23:55:39 user nova-compute[76391]:       <mac address="fa:16:3e:bc:aa:7e"/>
Nov 15 23:55:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:55:39 user nova-compute[76391]:       <mtu size="1442"/>
Nov 15 23:55:39 user nova-compute[76391]:       <target dev="tap5ff54394-3a"/>
Nov 15 23:55:39 user nova-compute[76391]:     </interface>
Nov 15 23:55:39 user nova-compute[76391]:     <serial type="pty">
Nov 15 23:55:39 user nova-compute[76391]:       <log file="/opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/console.log" append="off"/>
Nov 15 23:55:39 user nova-compute[76391]:     </serial>
Nov 15 23:55:39 user nova-compute[76391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 23:55:39 user nova-compute[76391]:     <video>
Nov 15 23:55:39 user nova-compute[76391]:       <model type="virtio"/>
Nov 15 23:55:39 user nova-compute[76391]:     </video>
Nov 15 23:55:39 user nova-compute[76391]:     <rng model="virtio">
Nov 15 23:55:39 user nova-compute[76391]:       <backend model="random">/dev/urandom</backend>
Nov 15 23:55:39 user nova-compute[76391]:     </rng>
Nov 15 23:55:39 user nova-compute[76391]:     <controller type="usb" index="0" model="none"/>
Nov 15 23:55:39 user nova-compute[76391]:     <memballoon model="virtio">
Nov 15 23:55:39 user nova-compute[76391]:       <stats period="10"/>
Nov 15 23:55:39 user nova-compute[76391]:     </memballoon>
Nov 15 23:55:39 user nova-compute[76391]:   </devices>
Nov 15 23:55:39 user nova-compute[76391]: </domain>
Nov 15 23:55:39 user nova-compute[76391]:  {{(pid=76391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-641440636',display_name='tempest-SnapshotDataIntegrityTests-server-641440636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-641440636',id=53,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtmw8mdDizvfn83KH43o+Wm1/DpV9bcbeSwTPq3Ye5Dmq6PMy7cA6i18nuwWglQPZLw4/H81PZLCHW+YKFAfm/yBbjycnHzIhRoJE+yLzJmJCJnvboyKm3Bmw0NvMiuIw==',key_name='tempest-keypair-1791845361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1470804f7034c829b0ed7891f4c08ae',ramdisk_id='',reservation_id='r-6gmgd0uw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-49990460',owner_user_name='tempest-SnapshotDataIntegrityTests-49990460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T23:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154e047f797643c08e29ff8532b1ec23',uuid=a4c84cfd-3fcd-432b-be46-7a17c7467095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Converting VIF {"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:aa:7e,bridge_name='br-int',has_traffic_filtering=True,id=5ff54394-3a9d-49fb-9950-fb26648194eb,network=Network(863d351d-3fb5-48d6-80f1-12d06853e299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff54394-3a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG os_vif [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:aa:7e,bridge_name='br-int',has_traffic_filtering=True,id=5ff54394-3a9d-49fb-9950-fb26648194eb,network=Network(863d351d-3fb5-48d6-80f1-12d06853e299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff54394-3a') {{(pid=76391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b111403e-b38d-5be5-87a6-b922df610c60', '_type': 'linux-noop'}}, row=False) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ff54394-3a, may_exist=True, interface_attrs={}) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ff54394-3a, col_values=(('qos', UUID('af70f04f-9c80-415a-8b69-480b1351fe1f')),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ff54394-3a, col_values=(('external_ids', {'iface-id': '5ff54394-3a9d-49fb-9950-fb26648194eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:aa:7e', 'vm-uuid': 'a4c84cfd-3fcd-432b-be46-7a17c7467095'}),), if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:39 user nova-compute[76391]: INFO os_vif [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:aa:7e,bridge_name='br-int',has_traffic_filtering=True,id=5ff54394-3a9d-49fb-9950-fb26648194eb,network=Network(863d351d-3fb5-48d6-80f1-12d06853e299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff54394-3a')
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:55:39 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No VIF found with MAC fa:16:3e:bc:aa:7e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:55:40 user nova-compute[76391]: DEBUG nova.network.neutron [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated VIF entry in instance network info cache for port 5ff54394-3a9d-49fb-9950-fb26648194eb. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:55:40 user nova-compute[76391]: DEBUG nova.network.neutron [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:55:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-09bcdd60-8e5b-42e7-a0a9-eb1a18cbb564 req-8b0d65e7-12e0-4cb7-ae93-f8b2e2403890 service nova] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-02527103-714d-4a31-91bb-f7264e478822 req-fe1085b6-0f4b-4285-bcf2-5a1c3b62e9b3 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-02527103-714d-4a31-91bb-f7264e478822 req-fe1085b6-0f4b-4285-bcf2-5a1c3b62e9b3 service nova] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-02527103-714d-4a31-91bb-f7264e478822 req-fe1085b6-0f4b-4285-bcf2-5a1c3b62e9b3 service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-02527103-714d-4a31-91bb-f7264e478822 req-fe1085b6-0f4b-4285-bcf2-5a1c3b62e9b3 service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG nova.compute.manager [req-02527103-714d-4a31-91bb-f7264e478822 req-fe1085b6-0f4b-4285-bcf2-5a1c3b62e9b3 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] No waiting events found dispatching network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:55:41 user nova-compute[76391]: WARNING nova.compute.manager [req-02527103-714d-4a31-91bb-f7264e478822 req-fe1085b6-0f4b-4285-bcf2-5a1c3b62e9b3 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received unexpected event network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb for instance with vm_state building and task_state spawning.
Nov 15 23:55:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:55:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:55:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Skipping network cache update for instance because it is Building. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 23:55:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-25a7ca04-038d-40f6-9df2-d752fa1f432d req-664c5200-a2b8-4d82-8ff1-a16975026367 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-25a7ca04-038d-40f6-9df2-d752fa1f432d req-664c5200-a2b8-4d82-8ff1-a16975026367 service nova] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-25a7ca04-038d-40f6-9df2-d752fa1f432d req-664c5200-a2b8-4d82-8ff1-a16975026367 service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-25a7ca04-038d-40f6-9df2-d752fa1f432d req-664c5200-a2b8-4d82-8ff1-a16975026367 service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.compute.manager [req-25a7ca04-038d-40f6-9df2-d752fa1f432d req-664c5200-a2b8-4d82-8ff1-a16975026367 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] No waiting events found dispatching network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 23:55:43 user nova-compute[76391]: WARNING nova.compute.manager [req-25a7ca04-038d-40f6-9df2-d752fa1f432d req-664c5200-a2b8-4d82-8ff1-a16975026367 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received unexpected event network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb for instance with vm_state building and task_state spawning.
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Instance event wait completed in 0 seconds for  {{(pid=76391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Guest created on hypervisor {{(pid=76391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 23:55:43 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Instance spawned successfully.
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Found default for hw_cdrom_bus of ide {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Found default for hw_disk_bus of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Found default for hw_input_bus of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Found default for hw_pointer_model of None {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Found default for hw_video_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Found default for hw_vif_model of virtio {{(pid=76391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 23:55:43 user nova-compute[76391]: INFO nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 15 23:55:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Checking state {{(pid=76391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 23:55:43 user nova-compute[76391]: INFO nova.compute.manager [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Took 7.24 seconds to build instance.
Nov 15 23:55:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-ab43f2b4-16a9-4c6f-a123-cc0c50bc07d1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.383s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:45 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:55:49 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:55:50 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:55:50 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:55:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.022018432617188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a4c84cfd-3fcd-432b-be46-7a17c7467095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:55:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:55:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:55:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:55:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:55:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:02 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:56:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:56:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:56:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:56:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:42 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:56:42 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:56:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:56:42 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:56:42 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:56:42 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:56:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:56:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:56:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:56:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:48 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:56:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:56:51 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:56:51 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:56:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.9925537109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a4c84cfd-3fcd-432b-be46-7a17c7467095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:56:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:56:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:56:54 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:56:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:56:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:02 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 23:57:02 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 23:57:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:57:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:17 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:17 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 23:57:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:57:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 23:57:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:57:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 23:57:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:57:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:57:26 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-changed-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 23:57:27 user nova-compute[76391]: DEBUG nova.compute.manager [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Refreshing instance network info cache due to event network-changed-5ff54394-3a9d-49fb-9950-fb26648194eb. {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 23:57:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:57:27 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:57:27 user nova-compute[76391]: DEBUG nova.network.neutron [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Refreshing network info cache for port 5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 23:57:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated VIF entry in instance network info cache for port 5ff54394-3a9d-49fb-9950-fb26648194eb. {{(pid=76391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 23:57:28 user nova-compute[76391]: DEBUG nova.network.neutron [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:57:28 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-f1b90740-acb1-4f37-84bc-fff00f249bd9 req-46549937-d86e-4ee9-bc5c-0f90242e2a3c service nova] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:57:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:57:30 user nova-compute[76391]: INFO nova.compute.manager [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attaching volume 5071bed7-8f9f-421e-a1dc-c5a7d928861a to /dev/vdb
Nov 15 23:57:30 user nova-compute[76391]: DEBUG os_brick.utils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3385f87d-0781-46ee-b3fe-205b12ad541f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6053bf0c-133b-4538-bcdc-36482ae6a371]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc6cd21-dd2f-4ac4-9483-55f7a4ef1b7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94d6113-17c8-4ac3-9710-edf5a1df1574]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:57:30 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:57:30 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9bf59-74e8-400e-87a9-fff830ea7207]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG os_brick.utils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:57:30 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating existing volume attachment record: d7997e1c-e0ac-4cc9-95a4-71161d3faefd {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:57:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:34 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIALpgoY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:57:35 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:57:35 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:57:35 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec619230-2160-44c6-a4da-d411c0214a94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:57:35 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b22e6d-fc2c-454a-a132-bad95adf1be8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a] added
Nov 15 23:57:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b8849c-aefd-420e-bfbe-a690cf43a89c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.159s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa88535a-4b6d-48e1-8675-2d964a98296a]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIALpgoY {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIALpgoY" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce21c27c-fdc3-44b3-909a-e5d9eb86036b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VIALpgoY'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24742c6-859f-495e-b385-b1157aa640b4]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[150ee9ab-f0f0-4902-9d1e-7a40d1da0d84]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:57:35 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:57:35 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:57:35 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:57:35 user nova-compute[76391]: 
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6817411c-4e11-470a-a4e0-7091e90426d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260]
Nov 15 23:57:35 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260] successful.
Nov 15 23:57:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eeebfe-a233-4edd-b3c3-cb426c926e5b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6215b5eb-0d37-47ce-9288-e6ec5d2cda77]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a (non-flash)
Nov 15 23:57:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a (non-flash)
Nov 15 23:57:35 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7019fdc1-817a-466f-aa04-ceb5ae3cf89c]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:57:35 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIALpgoY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23437613161333130', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437613161333130', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG nova.objects.instance [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:57:36 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:57:36 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:57:36 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:57:36 user nova-compute[76391]:   <serial>5071bed7-8f9f-421e-a1dc-c5a7d928861a</serial>
Nov 15 23:57:36 user nova-compute[76391]: </disk>
Nov 15 23:57:36 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:57:36 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No VIF found with MAC fa:16:3e:bc:aa:7e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:57:37 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-2bba660e-68e6-452d-8f1f-b9c7dc66f556 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.757s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:57:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:57:43 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:57:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:57:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:57:47 user nova-compute[76391]: INFO nova.compute.manager [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Detaching volume 5071bed7-8f9f-421e-a1dc-c5a7d928861a
Nov 15 23:57:47 user nova-compute[76391]: INFO nova.virt.block_device [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attempting to driver detach volume 5071bed7-8f9f-421e-a1dc-c5a7d928861a from mountpoint /dev/vdb
Nov 15 23:57:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Attempting to detach device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:57:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:57:47 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:57:47 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:57:47 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:57:47 user nova-compute[76391]:   <serial>5071bed7-8f9f-421e-a1dc-c5a7d928861a</serial>
Nov 15 23:57:47 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:57:47 user nova-compute[76391]: </disk>
Nov 15 23:57:47 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:57:47 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config.
Nov 15 23:57:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:57:47 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:57:47 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:57:47 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:57:47 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:57:47 user nova-compute[76391]:   <serial>5071bed7-8f9f-421e-a1dc-c5a7d928861a</serial>
Nov 15 23:57:47 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:57:47 user nova-compute[76391]: </disk>
Nov 15 23:57:47 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:57:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:57:49 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:57:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:57:51 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:57:51 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=24.98355484008789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a4c84cfd-3fcd-432b-be46-7a17c7467095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:57:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:57:52 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:52 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:57:55 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:55 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:57:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:57:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:02 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:08 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 is timed out.
Nov 15 23:58:08 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config.
Nov 15 23:58:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIALpgoY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:58:08 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aed430-b8f4-40ac-be6b-968d7d8911d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:58:08 user nova-compute[76391]: No targets found.
Nov 15 23:58:08 user nova-compute[76391]: iSNS:
Nov 15 23:58:08 user nova-compute[76391]: No targets found.
Nov 15 23:58:08 user nova-compute[76391]: STATIC:
Nov 15 23:58:08 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a
Nov 15 23:58:08 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:58:08 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:58:08 user nova-compute[76391]: FIRMWARE:
Nov 15 23:58:08 user nova-compute[76391]: No targets found.
Nov 15 23:58:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:58:08 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:58:08 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea2438e-0323-44bc-84ab-74c4c5cd4bc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d347db4-fc69-457a-8f2d-8344c4005fcb]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a (non-flash)
Nov 15 23:58:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a (non-flash)
Nov 15 23:58:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9760389bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a91bc1-67c9-4a03-bc38-d6aa006c4138]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03c527-f086-4f11-8fe2-142ca2c1434e]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f8411a-b4a3-4082-9e80-8bb80898969b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5486caf2-3bd4-471a-af9a-4fe7ad5b843a]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[523ce398-af44-4e9d-8d27-bbc549ac23b3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7e273c-e876-454d-bbf3-f1564040ae77]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260]
Nov 15 23:58:08 user nova-compute[76391]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a, portal: 172.16.0.220,3260] successful.
Nov 15 23:58:08 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5071bed7-8f9f-421e-a1dc-c5a7d928861a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d203ed-9d10-4c83-a217-567efe513e5f]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== disconnect_volume: return (296ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:58:08 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:58:09 user nova-compute[76391]: DEBUG nova.objects.instance [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:58:09 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-d93f65d5-723e-433b-b6de-c2028d43bd87 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.701s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:58:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:58:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:58:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:58:39 user nova-compute[76391]: DEBUG nova.objects.instance [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:58:39 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:58:40 user nova-compute[76391]: INFO nova.compute.manager [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attaching volume db0bc117-13a7-492c-b238-b06cd2f4db3d to /dev/vdb
Nov 15 23:58:40 user nova-compute[76391]: DEBUG os_brick.utils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b2bb6e-6251-4f96-9d45-e70cebc42acb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0e9e5-e6f8-4959-9df9-34558435acdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d96476-4fd5-4fb2-8511-01afca8b7d1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[447a6e68-3475-4260-8708-acd3ae3f821f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:58:40 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:58:40 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[785823c9-fc86-4a98-95bc-4ae033ae82de]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG os_brick.utils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:58:40 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating existing volume attachment record: b048c3a8-5768-40c4-bb06-96dbd599f399 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:58:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVLdYapq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:58:44 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:58:44 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:58:44 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[307694cd-17b8-4146-b25c-cfa6bb320931]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:58:44 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b2c1a-869b-4432-94f4-b2b617509938]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d] added
Nov 15 23:58:44 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f031072-eabf-476d-812f-ffa3a36c5b5e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[405fe839-7c2a-4688-9c03-a25a4723af23]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVLdYapq {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVLdYapq" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c2d8b-a05b-4809-9d61-40fbc53e3cf8]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVLdYapq'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a936ee7-7395-4f08-a52b-59b3b06cd975]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872fc80-2b87-4d80-9968-c98b9334cf7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:58:45 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:58:45 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:58:45 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:58:45 user nova-compute[76391]: 
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae02c438-1316-4edd-aac8-2912229bf058]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260]
Nov 15 23:58:45 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260] successful.
Nov 15 23:58:45 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5136b09d-78a6-4ca9-8de2-a6ea2a06ec02]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c2b22-28ad-4bd2-bc83-c9e5a2fde567]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d (non-flash)
Nov 15 23:58:45 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d (non-flash)
Nov 15 23:58:45 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e29a58e-c11b-4b31-928c-5c7b4e136d39]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:58:45 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVLdYapq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26464366261303466', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464366261303466', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG nova.objects.instance [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:58:46 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:58:46 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:58:46 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:58:46 user nova-compute[76391]:   <serial>db0bc117-13a7-492c-b238-b06cd2f4db3d</serial>
Nov 15 23:58:46 user nova-compute[76391]: </disk>
Nov 15 23:58:46 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No VIF found with MAC fa:16:3e:bc:aa:7e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:58:46 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-750876db-2490-4f7b-a504-a08c446d563d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.557s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:58:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:58:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:58:49 user nova-compute[76391]: INFO nova.compute.manager [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Detaching volume db0bc117-13a7-492c-b238-b06cd2f4db3d
Nov 15 23:58:49 user nova-compute[76391]: INFO nova.virt.block_device [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attempting to driver detach volume db0bc117-13a7-492c-b238-b06cd2f4db3d from mountpoint /dev/vdb
Nov 15 23:58:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Attempting to detach device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:58:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:58:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:58:49 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:58:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:58:49 user nova-compute[76391]:   <serial>db0bc117-13a7-492c-b238-b06cd2f4db3d</serial>
Nov 15 23:58:49 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:58:49 user nova-compute[76391]: </disk>
Nov 15 23:58:49 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:58:49 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config.
Nov 15 23:58:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:58:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:58:49 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:58:49 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:58:49 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:58:49 user nova-compute[76391]:   <serial>db0bc117-13a7-492c-b238-b06cd2f4db3d</serial>
Nov 15 23:58:49 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:58:49 user nova-compute[76391]: </disk>
Nov 15 23:58:49 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:58:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:58:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:58:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:58:51 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:58:51 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:58:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.98261260986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a4c84cfd-3fcd-432b-be46-7a17c7467095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:58:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:58:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:58:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:56 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:58:57 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:58:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:59:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:59:09 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 is timed out.
Nov 15 23:59:09 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config.
Nov 15 23:59:09 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVLdYapq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:59:09 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:59:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40918653-007f-4363-a791-e2ded5cceee7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 23:59:09 user nova-compute[76391]: No targets found.
Nov 15 23:59:09 user nova-compute[76391]: iSNS:
Nov 15 23:59:09 user nova-compute[76391]: No targets found.
Nov 15 23:59:09 user nova-compute[76391]: STATIC:
Nov 15 23:59:09 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d
Nov 15 23:59:09 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 15 23:59:09 user nova-compute[76391]:                 Iface Name: default
Nov 15 23:59:09 user nova-compute[76391]: FIRMWARE:
Nov 15 23:59:09 user nova-compute[76391]: No targets found.
Nov 15 23:59:09 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 23:59:09 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 23:59:09 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b86ee6-9954-49a7-a98d-46ddbaafdd25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:09 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79f790f-6b43-4550-8e70-9c9d17f4784c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d (non-flash)
Nov 15 23:59:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d (non-flash)
Nov 15 23:59:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97600ec5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faca6dd-7c9a-4284-8fc3-b5ee58139416]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53aa12b-c58d-4b36-907a-89423ed268b0]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f292d712-f080-4a5e-a9f2-209036d4f07e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b8b7d1-b856-4abc-affe-342e3a6b2d76]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[582905ed-a0aa-4242-9f15-725d36b92844]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be5b04c-a8b3-4927-8f31-be477691a93d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260]
Nov 15 23:59:10 user nova-compute[76391]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d, portal: 172.16.0.220,3260] successful.
Nov 15 23:59:10 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db0bc117-13a7-492c-b238-b06cd2f4db3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9066178-a2a4-45e0-8e34-bd8c522b3612]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== disconnect_volume: return (292ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG nova.objects.instance [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:59:10 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-1012468e-89c6-4fd4-9680-db5e3c513287 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.589s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:59:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:59:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 23:59:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:59:41 user nova-compute[76391]: INFO nova.compute.manager [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attaching volume 0fdc01d8-4dad-496e-a41d-b4cfa7b50bad to /dev/vdb
Nov 15 23:59:41 user nova-compute[76391]: DEBUG os_brick.utils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eb930a-6a03-4e94-aefc-438d7b1062f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c08a4b-50ee-41c1-8ee2-83394d09a637]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c036c441-caa3-4b09-acba-2b819fcd127b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24d69b-caa3-4bfb-b14a-50385b232caa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 23:59:41 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 23:59:41 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54d508f-d199-4bb3-84ff-1c0c81bc7a98]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG os_brick.utils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:59:41 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating existing volume attachment record: 850f6f68-f191-4070-93d7-e85720390d30 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 23:59:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EanSxItd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 23:59:46 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:59:46 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 23:59:46 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3005ec9-6501-4342-bad5-1a48bcd2b1ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 23:59:46 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77e9cf8-69cd-47e8-bb6e-9fed3ea930c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad] added
Nov 15 23:59:46 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc88095-c02c-4e5b-b993-045af17219f1]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d553be4-ef63-4081-90ca-a76ca43cd42b]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EanSxItd {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EanSxItd" returned: 0 in 0.025s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[293e3024-6380-4844-bcf6-4623017a1693]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EanSxItd'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f500e-7912-40ec-b0b2-b267e4f53f65]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d8716c-e6e4-4e3b-97bb-8549630db1a3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:59:46 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:59:46 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 23:59:46 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:59:46 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 23:59:46 user nova-compute[76391]: 
Nov 15 23:59:46 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --login" returned: 0 in 1.052s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49375c1-deef-4476-ad9b-a58c3fc28b63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260]
Nov 15 23:59:47 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260] successful.
Nov 15 23:59:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7bf32-8588-4c6e-9aa1-6916412fd490]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bebab0-f930-494c-9924-3b25e8810b3f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad (non-flash)
Nov 15 23:59:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad (non-flash)
Nov 15 23:59:47 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.257s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4203eae4-64aa-463d-8bde-d3cdb60c1956]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 23:59:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 23:59:48 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 23:59:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EanSxItd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 23:59:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.286s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 23:59:48 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== connect_volume: return (2288ms) {'type': 'block', 'scsi_wwn': '26464373664633062', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 23:59:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464373664633062', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 23:59:48 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 23:59:48 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 23:59:48 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:59:48 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:59:48 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:59:48 user nova-compute[76391]:   <serial>0fdc01d8-4dad-496e-a41d-b4cfa7b50bad</serial>
Nov 15 23:59:48 user nova-compute[76391]: </disk>
Nov 15 23:59:48 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 23:59:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:59:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 23:59:49 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No VIF found with MAC fa:16:3e:bc:aa:7e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 23:59:49 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fd7b980c-c950-4ce6-a8b8-2c27102765c0 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.553s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:59:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:50 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:59:51 user nova-compute[76391]: INFO nova.compute.manager [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Detaching volume 0fdc01d8-4dad-496e-a41d-b4cfa7b50bad
Nov 15 23:59:51 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 23:59:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 23:59:52 user nova-compute[76391]: INFO nova.virt.block_device [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attempting to driver detach volume 0fdc01d8-4dad-496e-a41d-b4cfa7b50bad from mountpoint /dev/vdb
Nov 15 23:59:52 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:59:52 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.981678009033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Attempting to detach device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:59:52 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:59:52 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:59:52 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:59:52 user nova-compute[76391]:   <serial>0fdc01d8-4dad-496e-a41d-b4cfa7b50bad</serial>
Nov 15 23:59:52 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:59:52 user nova-compute[76391]: </disk>
Nov 15 23:59:52 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:59:52 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config.
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 23:59:52 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 23:59:52 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 15 23:59:52 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 15 23:59:52 user nova-compute[76391]:   <serial>0fdc01d8-4dad-496e-a41d-b4cfa7b50bad</serial>
Nov 15 23:59:52 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 23:59:52 user nova-compute[76391]: </disk>
Nov 15 23:59:52 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a4c84cfd-3fcd-432b-be46-7a17c7467095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 23:59:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 23:59:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:55 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:55 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 23:59:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:57 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:57 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 23:59:58 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 23:59:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:06 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:12 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 is timed out.
Nov 16 00:00:12 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config.
Nov 16 00:00:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EanSxItd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:00:12 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7eaea8-c730-4523-9594-5a5427170ba6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:00:12 user nova-compute[76391]: No targets found.
Nov 16 00:00:12 user nova-compute[76391]: iSNS:
Nov 16 00:00:12 user nova-compute[76391]: No targets found.
Nov 16 00:00:12 user nova-compute[76391]: STATIC:
Nov 16 00:00:12 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad
Nov 16 00:00:12 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:00:12 user nova-compute[76391]:                 Iface Name: default
Nov 16 00:00:12 user nova-compute[76391]: FIRMWARE:
Nov 16 00:00:12 user nova-compute[76391]: No targets found.
Nov 16 00:00:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:00:12 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:00:12 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad0cb52-9d18-42fd-a462-e65200a3552e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a240df1-f457-49d1-994c-05f257a84866]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad (non-flash)
Nov 16 00:00:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad (non-flash)
Nov 16 00:00:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9764956cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d940e8-d46f-4944-b151-4f32cf1e1e51]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[500bc6ff-a3e0-479e-852f-3afbd7aeaac0]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf332d-774a-4bec-8bf7-620fbcbb68e9]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f26cc5-fb30-461d-b071-88789060c116]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a2ce3-57d7-476f-81a3-1bb508043298]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbae4a5-4c84-470b-ac77-59929a11b80c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260]
Nov 16 00:00:12 user nova-compute[76391]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad, portal: 172.16.0.220,3260] successful.
Nov 16 00:00:12 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdc01d8-4dad-496e-a41d-b4cfa7b50bad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e8774-0d5f-40dc-a3fd-f07e76ad8c52]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== disconnect_volume: return (303ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:00:12 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:00:13 user nova-compute[76391]: DEBUG nova.objects.instance [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:00:13 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-f943a4a1-7407-46f4-a3a1-726b2fb53d0d tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.908s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:00:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:00:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:00:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:00:43 user nova-compute[76391]: DEBUG nova.objects.instance [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:00:43 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:00:44 user nova-compute[76391]: INFO nova.compute.manager [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attaching volume 6b58e9fb-4603-4002-8d72-cab46026add1 to /dev/vdb
Nov 16 00:00:44 user nova-compute[76391]: DEBUG os_brick.utils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f202e-354f-4d22-9706-dfb0729c2187]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:363c7e6d27f\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f9bf6-6625-41c7-a4fc-f33915638491]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c27d03f-bdf3-4207-9420-28b348dfba79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8476b916-7aa3-4742-bed6-00ad2c1ad4b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Running cmd (subprocess): nvme version {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] 'nvme version' failed. Not Retrying. {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] nvme not present on system {{(pid=76391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:00:44 user nova-compute[76391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:00:44 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4543d432-18f4-449d-b6b5-5d70bfa1fb23]: (4, '') {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.lightos [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] LIGHTOS: no hostnqn found. {{(pid=76391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG os_brick.utils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:363c7e6d27f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG nova.virt.block_device [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating existing volume attachment record: 6220055b-5456-473c-a4cc-086b75273362 {{(pid=76391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:00:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:00:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:00:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Calling os-brick to attach iSCSI Volume {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJWgmUaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:00:50 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:00:50 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:00:50 user nova-compute[76391]: INFO os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6339bc50-1862-49dc-bd08-1e45fbd654a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:00:50 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[628c04b9-d3ee-434b-9625-d2573f9b75eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1] added\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1] added
Nov 16 00:00:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d29d1-a3dd-4913-98ca-c00d5cb99cb3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce145f21-b562-4898-a1e4-0c6ba7b101a2]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJWgmUaQ {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJWgmUaQ" returned: 0 in 0.019s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a5a211-077e-4608-9a80-5c52254c3e62]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJWgmUaQ'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7935a112-d518-49c6-9f25-98bab4e1b2d3]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeadac9-d202-4773-8676-9dc0d8697e34]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 00:00:50 user nova-compute[76391]:  {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 00:00:50 user nova-compute[76391]:  {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:00:50 user nova-compute[76391]: WARNING os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 00:00:50 user nova-compute[76391]: 
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --login {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3647cb72-0e03-493e-beb1-b6f2534801de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260]
Nov 16 00:00:50 user nova-compute[76391]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260] successful.
Nov 16 00:00:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[717486be-44a9-4ad1-a75d-9484de396978]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[197241e4-8171-499e-b64b-8832adebacfd]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 (non-flash)
Nov 16 00:00:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 (non-flash)
Nov 16 00:00:50 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to 172.16.0.220:3260 {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=76391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82529f20-8931-494f-971a-5d81232fb5ae]: (4, ('- - 0', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:00:50 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJWgmUaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23265386261313365', 'path': '/dev/sdb'} {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265386261313365', 'path': '/dev/sdb'} {{(pid=76391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG nova.objects.instance [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:00:51 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:00:51 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 16 00:00:51 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:00:51 user nova-compute[76391]:   <serial>6b58e9fb-4603-4002-8d72-cab46026add1</serial>
Nov 16 00:00:51 user nova-compute[76391]: </disk>
Nov 16 00:00:51 user nova-compute[76391]:  {{(pid=76391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vda, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:00:51 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] No VIF found with MAC fa:16:3e:bc:aa:7e, not building metadata {{(pid=76391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-b7aa4c12-2267-465f-b562-fa48dc20f3f1 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.007s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:00:52 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:00:53 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:00:53 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:00:53 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.980030059814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a4c84cfd-3fcd-432b-be46-7a17c7467095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:00:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:00:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:00:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:00:54 user nova-compute[76391]: INFO nova.compute.manager [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Detaching volume 6b58e9fb-4603-4002-8d72-cab46026add1
Nov 16 00:00:54 user nova-compute[76391]: INFO nova.virt.block_device [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Attempting to driver detach volume 6b58e9fb-4603-4002-8d72-cab46026add1 from mountpoint /dev/vdb
Nov 16 00:00:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Attempting to detach device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config. {{(pid=76391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:00:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:00:54 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:00:54 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 16 00:00:54 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:00:54 user nova-compute[76391]:   <serial>6b58e9fb-4603-4002-8d72-cab46026add1</serial>
Nov 16 00:00:54 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:00:54 user nova-compute[76391]: </disk>
Nov 16 00:00:54 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:00:54 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the persistent domain config.
Nov 16 00:00:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config. {{(pid=76391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:00:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.guest [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:00:54 user nova-compute[76391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:00:54 user nova-compute[76391]:   <source dev="/dev/sdb"/>
Nov 16 00:00:54 user nova-compute[76391]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:00:54 user nova-compute[76391]:   <serial>6b58e9fb-4603-4002-8d72-cab46026add1</serial>
Nov 16 00:00:54 user nova-compute[76391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:00:54 user nova-compute[76391]: </disk>
Nov 16 00:00:54 user nova-compute[76391]:  {{(pid=76391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:00:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:54 user nova-compute[76391]: DEBUG nova.virt.libvirt.driver [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:00:55 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:55 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:00:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:57 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:59 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:59 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:00:59 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:00:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:04 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:09 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:14 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 is timed out.
Nov 16 00:01:14 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully detached device vdb from instance a4c84cfd-3fcd-432b-be46-7a17c7467095 from the live domain config.
Nov 16 00:01:14 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] calling os-brick to detach iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f97603b2350>, {'target_iqn': 'iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJWgmUaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:01:14 user nova-compute[76391]: WARNING os_brick.initiator.connectors.base [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9fd0e7-7228-435f-a5d1-70958ec2f3d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:01:14 user nova-compute[76391]: No targets found.
Nov 16 00:01:14 user nova-compute[76391]: iSNS:
Nov 16 00:01:14 user nova-compute[76391]: No targets found.
Nov 16 00:01:14 user nova-compute[76391]: STATIC:
Nov 16 00:01:14 user nova-compute[76391]: Target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1
Nov 16 00:01:14 user nova-compute[76391]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:01:14 user nova-compute[76391]:                 Iface Name: default
Nov 16 00:01:14 user nova-compute[76391]: FIRMWARE:
Nov 16 00:01:14 user nova-compute[76391]: No targets found.
Nov 16 00:01:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:01:14 user nova-compute[76391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:01:14 user nova-compute[76391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1', 0)] {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47118ae9-09ff-4290-91f5-8dc186d171fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac3c5a0-f063-421b-81a4-3647cc8129f6]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 (non-flash)\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 (non-flash)
Nov 16 00:01:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 (non-flash)
Nov 16 00:01:14 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f97405868c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1'): ({'sdb'}, set())}) {{(pid=76391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Removing single pathed devices sdb {{(pid=76391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6354c9cd-ad9a-45c6-8417-96e6834f4ecf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fbf9e9-ffd8-42a8-9527-e6a3c56cc449]: (4, ('ok\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Flushing IO for device /dev/sdb {{(pid=76391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:01:14 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e6a6fd-29d9-45b0-88c5-9ea2fa6ad76e]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7469f5c4-ad66-4323-8707-f098de047020]: (4, ('1', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.linuxscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] SCSI volumes sdb have been removed. {{(pid=76391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1')] {{(pid=76391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95d2c9d-8056-4759-9466-91dd66cf2bb5]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --logout {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[815382ac-bc55-4d59-a7b9-6ed81beeffce]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260]
Nov 16 00:01:15 user nova-compute[76391]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1, portal: 172.16.0.220,3260] successful.
Nov 16 00:01:15 user nova-compute[76391]:  stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op delete {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b58e9fb-4603-4002-8d72-cab46026add1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca784e3d-8af9-4f72-b253-14f4ca33638c]: (4, ('', '')) {{(pid=86206) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.base [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] <== disconnect_volume: return (315ms) None {{(pid=76391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Disconnected iSCSI Volume {{(pid=76391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG nova.objects.instance [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'flavor' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:01:15 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-95da7ab6-081d-4cb1-be54-9a89e0f7db66 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:01:19 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:24 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:29 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:34 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:01:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 00:01:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:01:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:01:39 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:44 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:01:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:01:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:01:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:01:47 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquired lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:01:47 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Forcefully refreshing network info cache for instance {{(pid=76391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:01:47 user nova-compute[76391]: DEBUG nova.objects.instance [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lazy-loading 'info_cache' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:01:48 user nova-compute[76391]: DEBUG nova.network.neutron [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [{"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:01:48 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Releasing lock "refresh_cache-a4c84cfd-3fcd-432b-be46-7a17c7467095" {{(pid=76391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:01:48 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updated the network info_cache for instance {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:01:49 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:01:53 user nova-compute[76391]: DEBUG oslo_concurrency.processutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:01:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:01:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:01:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.979175567626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Instance a4c84cfd-3fcd-432b-be46-7a17c7467095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:01:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:01:55 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:01:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:01:57 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:01:58 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:01:59 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:02:00 user nova-compute[76391]: INFO nova.compute.manager [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Terminating instance
Nov 16 00:02:00 user nova-compute[76391]: DEBUG nova.compute.manager [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Start destroying the instance on the hypervisor. {{(pid=76391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:00 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-fe68fd78-f60a-4521-88aa-c55c59107a65 req-d3ad47ec-37ed-4a98-b935-56964f7abd3f service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-vif-unplugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fe68fd78-f60a-4521-88aa-c55c59107a65 req-d3ad47ec-37ed-4a98-b935-56964f7abd3f service nova] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fe68fd78-f60a-4521-88aa-c55c59107a65 req-d3ad47ec-37ed-4a98-b935-56964f7abd3f service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-fe68fd78-f60a-4521-88aa-c55c59107a65 req-d3ad47ec-37ed-4a98-b935-56964f7abd3f service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-fe68fd78-f60a-4521-88aa-c55c59107a65 req-d3ad47ec-37ed-4a98-b935-56964f7abd3f service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] No waiting events found dispatching network-vif-unplugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.compute.manager [req-fe68fd78-f60a-4521-88aa-c55c59107a65 req-d3ad47ec-37ed-4a98-b935-56964f7abd3f service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-vif-unplugged-5ff54394-3a9d-49fb-9950-fb26648194eb for instance with task_state deleting. {{(pid=76391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:02:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [-] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Instance destroyed successfully.
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.objects.instance [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lazy-loading 'resources' on Instance uuid a4c84cfd-3fcd-432b-be46-7a17c7467095 {{(pid=76391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.virt.libvirt.vif [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T23:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-641440636',display_name='tempest-SnapshotDataIntegrityTests-server-641440636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-641440636',id=53,image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtmw8mdDizvfn83KH43o+Wm1/DpV9bcbeSwTPq3Ye5Dmq6PMy7cA6i18nuwWglQPZLw4/H81PZLCHW+YKFAfm/yBbjycnHzIhRoJE+yLzJmJCJnvboyKm3Bmw0NvMiuIw==',key_name='tempest-keypair-1791845361',keypairs=<?>,launch_index=0,launched_at=2023-11-15T23:55:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1470804f7034c829b0ed7891f4c08ae',ramdisk_id='',reservation_id='r-6gmgd0uw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9fefdfab-50b0-4bb0-961e-aba7120d0851',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-49990460',owner_user_name='tempest-SnapshotDataIntegrityTests-49990460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T23:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154e047f797643c08e29ff8532b1ec23',uuid=a4c84cfd-3fcd-432b-be46-7a17c7467095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Converting VIF {"id": "5ff54394-3a9d-49fb-9950-fb26648194eb", "address": "fa:16:3e:bc:aa:7e", "network": {"id": "863d351d-3fb5-48d6-80f1-12d06853e299", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-362414414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1470804f7034c829b0ed7891f4c08ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff54394-3a", "ovs_interfaceid": "5ff54394-3a9d-49fb-9950-fb26648194eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.network.os_vif_util [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:aa:7e,bridge_name='br-int',has_traffic_filtering=True,id=5ff54394-3a9d-49fb-9950-fb26648194eb,network=Network(863d351d-3fb5-48d6-80f1-12d06853e299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff54394-3a') {{(pid=76391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG os_vif [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:aa:7e,bridge_name='br-int',has_traffic_filtering=True,id=5ff54394-3a9d-49fb-9950-fb26648194eb,network=Network(863d351d-3fb5-48d6-80f1-12d06853e299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff54394-3a') {{(pid=76391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ff54394-3a, bridge=br-int, if_exists=True) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af70f04f-9c80-415a-8b69-480b1351fe1f) {{(pid=76391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:02:01 user nova-compute[76391]: INFO os_vif [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:aa:7e,bridge_name='br-int',has_traffic_filtering=True,id=5ff54394-3a9d-49fb-9950-fb26648194eb,network=Network(863d351d-3fb5-48d6-80f1-12d06853e299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff54394-3a')
Nov 16 00:02:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Deleting instance files /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095_del
Nov 16 00:02:01 user nova-compute[76391]: INFO nova.virt.libvirt.driver [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Deletion of /opt/stack/data/nova/instances/a4c84cfd-3fcd-432b-be46-7a17c7467095_del complete
Nov 16 00:02:01 user nova-compute[76391]: INFO nova.compute.manager [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 00:02:01 user nova-compute[76391]: DEBUG oslo.service.loopingcall [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.compute.manager [-] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Deallocating network for instance {{(pid=76391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:02:01 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] deallocate_for_instance() {{(pid=76391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:02:02 user nova-compute[76391]: DEBUG nova.network.neutron [-] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Updating instance_info_cache with network_info: [] {{(pid=76391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:02:02 user nova-compute[76391]: INFO nova.compute.manager [-] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Took 0.78 seconds to deallocate network for instance.
Nov 16 00:02:02 user nova-compute[76391]: DEBUG nova.compute.manager [req-7f601a96-f1f3-42ac-bb58-7afb8abbc79d req-8856abbe-41d7-47db-9a1b-afc5811a3cde service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-vif-deleted-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:02:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:02:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:02:02 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:02:02 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:02:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:02:02 user nova-compute[76391]: INFO nova.scheduler.client.report [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Deleted allocations for instance a4c84cfd-3fcd-432b-be46-7a17c7467095
Nov 16 00:02:02 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-000c7a0d-f6a7-4adc-9b9a-2aff9e165441 tempest-SnapshotDataIntegrityTests-49990460 tempest-SnapshotDataIntegrityTests-49990460-project-member] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.005s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:02:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-31dfc9c8-0c3b-420b-ad5a-77fa6cf063ee req-8002e7e0-920c-484d-883e-18d2531a2080 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received event network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:02:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-31dfc9c8-0c3b-420b-ad5a-77fa6cf063ee req-8002e7e0-920c-484d-883e-18d2531a2080 service nova] Acquiring lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:02:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-31dfc9c8-0c3b-420b-ad5a-77fa6cf063ee req-8002e7e0-920c-484d-883e-18d2531a2080 service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:02:03 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [req-31dfc9c8-0c3b-420b-ad5a-77fa6cf063ee req-8002e7e0-920c-484d-883e-18d2531a2080 service nova] Lock "a4c84cfd-3fcd-432b-be46-7a17c7467095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:02:03 user nova-compute[76391]: DEBUG nova.compute.manager [req-31dfc9c8-0c3b-420b-ad5a-77fa6cf063ee req-8002e7e0-920c-484d-883e-18d2531a2080 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] No waiting events found dispatching network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb {{(pid=76391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:02:03 user nova-compute[76391]: WARNING nova.compute.manager [req-31dfc9c8-0c3b-420b-ad5a-77fa6cf063ee req-8002e7e0-920c-484d-883e-18d2531a2080 service nova] [instance: a4c84cfd-3fcd-432b-be46-7a17c7467095] Received unexpected event network-vif-plugged-5ff54394-3a9d-49fb-9950-fb26648194eb for instance with vm_state deleted and task_state None.
Nov 16 00:02:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:10 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] There are 0 instances to clean {{(pid=76391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:02:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:20 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:20 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 00:02:21 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:02:22 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:26 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:29 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:31 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:36 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:02:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:02:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 00:02:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:02:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:02:41 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:46 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:47 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Starting heal instance info cache {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:02:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Rebuilding the list of instances to heal {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:02:47 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Didn't find any instances for network info cache update. {{(pid=76391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:02:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:51 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Auditing locally available compute resources for user (node: user) {{(pid=76391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:02:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:02:54 user nova-compute[76391]: WARNING nova.virt.libvirt.driver [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=25.006084442138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing inventories for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating ProviderTree inventory for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Updating inventory in ProviderTree for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 00:02:54 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing aggregate associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, aggregates: None {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 00:02:55 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Refreshing trait associations for resource provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=76391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 00:02:55 user nova-compute[76391]: DEBUG nova.compute.provider_tree [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed in ProviderTree for provider: 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 {{(pid=76391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:02:55 user nova-compute[76391]: DEBUG nova.scheduler.client.report [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Inventory has not changed for provider 5143780f-9ae3-45b9-9ec1-f2c0aa8048b3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:02:55 user nova-compute[76391]: DEBUG nova.compute.resource_tracker [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Compute_service record updated for user:user {{(pid=76391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:02:55 user nova-compute[76391]: DEBUG oslo_concurrency.lockutils [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=76391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:02:56 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:56 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:57 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:02:57 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:57 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:02:59 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:03:01 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:03:03 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:03:03 user nova-compute[76391]: DEBUG oslo_service.periodic_task [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:03:03 user nova-compute[76391]: DEBUG nova.compute.manager [None req-fb544dc3-e76f-416b-8ce6-2d58bce65177 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:03:06 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:03:11 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:03:16 user nova-compute[76391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}